Sep 17 07:11:32 devstack cinder-volume[75013]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 07:11:32 devstack cinder-volume[75013]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 07:11:32 devstack cinder-volume[75013]: we strongly recommend against using it for new projects. Sep 17 07:11:32 devstack cinder-volume[75013]: If you are already using Eventlet, we recommend migrating to a different Sep 17 07:11:32 devstack cinder-volume[75013]: framework. For more detail see Sep 17 07:11:32 devstack cinder-volume[75013]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 07:11:32 devstack cinder-volume[75013]: import eventlet # noqa Sep 17 07:11:35 devstack cinder-volume[75013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 07:11:35 devstack cinder-volume[75013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 07:11:35 devstack cinder-volume[75013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 07:11:36 devstack cinder-volume[75013]: INFO dbcounter [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Registered counter for database cinder Sep 17 07:11:36 devstack cinder-volume[75013]: DEBUG oslo_db.sqlalchemy.engines [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG dbcounter [-] [75013] Writer thread running {{(pid=75013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 07:11:37 devstack cinder-volume[75013]: INFO cinder.rpc [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 07:11:37 devstack cinder-volume[75013]: INFO cinder.rpc [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_db.sqlalchemy.engines [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 07:11:37 devstack cinder-volume[75013]: INFO cinder.volume.manager [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Determined volume DB was empty at startup. Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG cinder.volume.manager [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75013) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 07:11:37 devstack cinder-volume[75013]: INFO cinder.volume.manager [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 07:11:37 devstack cinder-volume[75013]: WARNING stevedore.named [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 07:11:37 devstack cinder-volume[75013]: WARNING castellan.key_manager [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 07:11:37 devstack cinder-volume[75013]: WARNING cinder.keymgr.conf_key_mgr [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG cinder.volume.drivers.lvm [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75013) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_concurrency.processutils [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_concurrency.processutils [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] CMD "cinder-rtstool verify" returned: 0 in 0.446s {{(pid=75013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_db.sqlalchemy.engines [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 07:11:37 devstack cinder-volume[75013]: INFO cinder.rpc [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 17 07:11:37 devstack cinder-volume[75013]: INFO cinder.rpc [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 17 07:11:37 devstack cinder-volume[75013]: WARNING stevedore.named [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 07:11:37 devstack cinder-volume[75013]: WARNING castellan.key_manager [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 07:11:37 devstack cinder-volume[75013]: INFO cinder.volume.manager [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_db.sqlalchemy.engines [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 07:11:37 devstack cinder-volume[75013]: INFO oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Starting 1 workers Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Started child 75203 {{(pid=75013) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Full set of CONF: {{(pid=75013) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] ******************************************************************************** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Configuration options gathered from: {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] ================================================================================ {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] allow_availability_zone_fallback = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] allow_compression_on_image_upload = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] allowed_direct_url_schemes = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] api_rate_limit = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] auth_strategy = keystone {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] az_cache_duration = 3600 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_availability_zone = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_host = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_stats_polling_interval = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backup_api_class = cinder.backup.api.API {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backup_name_template = backup-%s {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backup_use_same_host = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backup_use_temp_snapshot = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] chap_password = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] chap_username = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cinder_internal_tenant_project_id = 3d4e04f7040f47b1b3f1d7683ca494e9 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cinder_internal_tenant_user_id = f165d006610f424cac118574fc11d572 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cloned_volume_same_az = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75203]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cluster = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] compression_format = gzip {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] compute_api_class = cinder.compute.nova.API {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] config_dir = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] config_source = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] control_exchange = openstack {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] debug = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] default_availability_zone = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] default_group_type = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] default_volume_type = lvmdriver-1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] disk_geometry = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] driver_client_cert = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] driver_client_cert_key = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] driver_data_namespace = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] driver_ssl_cert_path = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] driver_ssl_cert_verify = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] driver_use_ssl = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] enable_force_upload = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] enable_new_services = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] enable_unsupported_driver = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] enforce_multipath_for_image_xfer = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] filter_function = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance_api_insecure = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance_api_servers = ['http://192.168.122.16/image'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance_api_ssl_compression = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance_ca_certificates_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance_catalog_info = image:glance:publicURL {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance_certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance_keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance_num_retries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance_request_timeout = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] goodness_function = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] graceful_shutdown_timeout = 5 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] group_api_class = cinder.group.api.API {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] host = devstack {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] image_compress_on_upload = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:37 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] image_conversion_address_space_limit = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] image_conversion_cpu_limit = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] image_conversion_disable = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] image_introspection_address_space_limit = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] image_introspection_cpu_limit = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] image_upload_use_cinder_backend = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] image_upload_use_internal_tenant = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] image_volume_cache_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] image_volume_cache_max_count = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] image_volume_cache_max_size_gb = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] init_host_max_objects_retrieval = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] instance_format = [instance: %(uuid)s] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] iscsi_target_flags = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] iscsi_write_cache = on {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] iser_helper = tgtadm {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] iser_ip_address = 192.168.122.16 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] iser_port = 3260 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] log_color = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] log_config_append = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] log_dir = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] log_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] log_options = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] log_rotate_interval = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] log_rotate_interval_type = days {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] log_rotation_type = none {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] max_age = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] max_logfile_count = 30 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] max_logfile_size_mb = 200 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] max_over_subscription_ratio = 20.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] message_reap_interval = 86400 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] message_ttl = 2592000 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] migration_create_volume_timeout_secs = 300 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] monkey_patch = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] monkey_patch_modules = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] my_ip = 192.168.122.16 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] no_snapshot_gb_quota = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] num_iser_scan_tries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] num_shell_tries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] num_volume_device_scan_tries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] nvmeof_conn_info_version = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] nvmet_ns_id = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] nvmet_port_id = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] osapi_max_limit = 1000 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] osapi_volume_ext_list = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] osapi_volume_listen_port = 8776 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] osapi_volume_use_ssl = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] osapi_volume_workers = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] per_volume_size_limit = -1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] periodic_fuzzy_delay = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] periodic_interval = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] public_endpoint = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] publish_errors = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] quota_backup_gigabytes = 1000 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] quota_backups = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] quota_gigabytes = 1000 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] quota_groups = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] quota_snapshots = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] quota_volumes = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] rate_limit_burst = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] rate_limit_except_level = CRITICAL {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] rate_limit_interval = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] reinit_driver_count = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] replication_device = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] report_discard_supported = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] report_interval = 120 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] reservation_clean_interval = 86400 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] reservation_expire = 86400 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] reserved_image_namespaces = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] reserved_percentage = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] rpc_response_timeout = 120 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] run_external_periodic_tasks = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] scst_target_driver = iscsi {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] scst_target_iqn_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] service_down_time = 720 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] shell_completion = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] snapshot_name_template = snapshot-%s {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] snapshot_same_host = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] split_loggers = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] state_path = /opt/stack/data/cinder {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] storage_availability_zone = nova {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] storage_protocol = iSCSI {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] syslog_log_facility = LOG_USER {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] target_helper = lioadm {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] target_ip_address = 192.168.122.16 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] target_port = 3260 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] target_protocol = iscsi {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] target_secondary_ip_addresses = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] trace_flags = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] transport_url = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] until_refresh = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] use_chap_auth = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] use_default_quota_class = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] use_journal = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] use_json = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] use_multipath_for_image_xfer = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] use_stderr = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] use_syslog = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] verify_glance_signatures = enabled {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] volume_api_class = cinder.volume.api.API {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] volume_backend_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] volume_clear = zero {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] volume_clear_ionice = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] volume_clear_size = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] volume_copy_bps_limit = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] volume_dd_blocksize = 1M {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] volume_name_template = volume-%s {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] volume_service_inithost_offload = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] volume_usage_audit_period = month {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] zoning_mode = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_concurrency.disable_process_locking = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.auth_section = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.auth_type = password {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.auth_version = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.cache = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.include_service_catalog = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.insecure = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.interface = public {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_password = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcache_username = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.region_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.service_type = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.backend = dogpile.cache.null {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.backend_argument = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.backend_expiration_time = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.config_prefix = cache.oslo {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.debug_cache_backend = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75203]: INFO cinder.volume.manager [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.enable_retry_client = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.enable_socket_keepalive = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.expiration_time = 600 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.hashclient_retry_attempts = 2 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.memcache_dead_retry = 300 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.memcache_pool_maxsize = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.memcache_sasl_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.password = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.proxies = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.redis_db = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.redis_server = localhost:6379 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.retry_attempts = 2 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.retry_delay = 0.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.socket_keepalive_count = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.socket_keepalive_idle = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.socket_keepalive_interval = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.socket_timeout = 1.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.tls_allowed_ciphers = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.tls_cafile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.tls_certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.tls_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.tls_keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cache.username = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] coordination.backend_url = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.asyncio_connection = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.asyncio_slave_connection = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.backend = sqlalchemy {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.connection = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.connection_debug = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.connection_parameters = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.connection_recycle_time = 3600 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.connection_trace = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.db_inc_retry_interval = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.db_max_retries = 20 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.db_max_retry_interval = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.db_retry_interval = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.max_overflow = 50 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.max_pool_size = 5 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.max_retries = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.mysql_wsrep_sync_wait = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.pool_timeout = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.retry_interval = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.slave_connection = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.sqlite_synchronous = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.synchronous_reader = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] database.use_db_reconnect = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_tracing.insecure = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] profiler.connection_string = messaging:// {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] profiler.enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] profiler.es_doc_type = notification {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] profiler.es_scroll_size = 10000 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] profiler.es_scroll_time = 2m {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] profiler.filter_error_trace = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] profiler.hmac_keys = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] profiler.sentinel_service_name = mymaster {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] profiler.socket_timeout = 0.1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] profiler.trace_requests = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] profiler.trace_sqlalchemy = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] profiler_jaeger.process_tags = {} {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] profiler_jaeger.service_name_prefix = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] profiler_otlp.service_name_prefix = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_policy.enforce_new_defaults = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_policy.policy_default_rule = default {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_policy.policy_file = policy.yaml {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] privsep_osbrick.group = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] privsep_osbrick.helper_command = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] privsep_osbrick.user = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cinder_sys_admin.group = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cinder_sys_admin.helper_command = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] cinder_sys_admin.user = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] service_user.auth_section = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] service_user.auth_type = password {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] service_user.cafile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] service_user.certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] service_user.collect_timing = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] service_user.insecure = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] service_user.keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] service_user.send_service_user_token = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] service_user.split_loggers = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] service_user.timeout = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] service_user.tls_ciphers = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] service_user.tls_min_version = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance.auth_section = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance.auth_type = password {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance.certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance.collect_timing = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance.insecure = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance.keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance.region_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance.split_loggers = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance.timeout = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance.tls_ciphers = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] glance.tls_min_version = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.backend_availability_zone = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.chap_password = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.chap_username = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.disk_geometry = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.driver_client_cert = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.driver_client_cert_key = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.driver_data_namespace = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.driver_use_ssl = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.extra_capabilities = {} {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.filter_function = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.goodness_function = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.iscsi_target_flags = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.iscsi_write_cache = on {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.iser_helper = tgtadm {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.iser_port = 3260 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.lvm_share_target = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.lvm_type = auto {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.num_shell_tries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.replication_device = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.report_discard_supported = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.reserved_percentage = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.target_helper = tgtadm {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.target_port = 3260 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.target_protocol = iscsi {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.trace_flags = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.unique_fqdn_network = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.use_chap_auth = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.volume_backend_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.volume_clear = zero {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.volume_clear_ionice = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.volume_clear_size = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_reports.file_event_handler = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_reports.log_dir = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.backend_host = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.chap_password = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.chap_username = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.disk_geometry = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.driver_client_cert = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.extra_capabilities = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.filter_function = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.goodness_function = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.iser_helper = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.iser_ip_address = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.iser_port = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.lvm_share_target = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.lvm_type = auto {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.num_shell_tries = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.replication_device = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.report_discard_supported = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.reserved_percentage = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.scst_target_driver = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.storage_protocol = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack sudo[75207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.target_helper = lioadm {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack sudo[75207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.target_ip_address = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.target_port = 3260 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.trace_flags = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.use_chap_auth = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.volume_clear = zero {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.volume_clear_size = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] lvmdriver-1.volumes_dir = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.ssl = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_notifications.driver = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_notifications.retry = -1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] key_manager.fixed_key = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.barbican_api_version = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.barbican_endpoint = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.barbican_endpoint_type = public {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.barbican_region_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.cafile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.collect_timing = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.insecure = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.number_of_retries = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.retry_delay = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.send_service_user_token = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.split_loggers = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.timeout = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.tls_ciphers = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.tls_min_version = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.verify_ssl = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican.verify_ssl_path = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican_service_user.auth_section = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican_service_user.auth_type = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican_service_user.cafile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican_service_user.certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican_service_user.collect_timing = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican_service_user.insecure = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican_service_user.keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican_service_user.split_loggers = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican_service_user.timeout = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican_service_user.tls_ciphers = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] barbican_service_user.tls_min_version = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.approle_role_id = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.approle_secret_id = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.auth_method = approle {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.auth_path = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.kv_mountpoint = secret {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.kv_path = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.kv_version = 2 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.namespace = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.root_token_id = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.ssl_ca_crt_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.timeout = 60.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.token_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.token_role = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.use_ssl = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:11:38 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] ******************************************************************************** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 07:11:38 devstack sudo[75207]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:38 devstack sudo[75277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:11:38 devstack sudo[75277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:38 devstack sudo[75277]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.258s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:11:38 devstack cinder-volume[75203]: INFO cinder.brick.local_dev.lvm [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:38 devstack sudo[75400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:11:38 devstack sudo[75400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:38 devstack sudo[75400]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG cinder.brick.local_dev.lvm [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75203) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 17 07:11:38 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:38 devstack sudo[75486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:11:38 devstack sudo[75486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:39 devstack sudo[75486]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:39 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:39 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:39 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:39 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:39 devstack sudo[75667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:11:39 devstack sudo[75667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:39 devstack sudo[75667]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:39 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:39 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:39 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:39 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:39 devstack sudo[75801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 17 07:11:39 devstack sudo[75801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:40 devstack sudo[75801]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:40 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.264s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:40 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:40 devstack sudo[75814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:11:40 devstack sudo[75814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:40 devstack sudo[75814]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:40 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:40 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:40 devstack sudo[75874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:11:40 devstack sudo[75874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:40 devstack sudo[75874]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:40 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:40 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:40 devstack sudo[75900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:11:40 devstack sudo[75900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:40 devstack sudo[75900]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:40 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:40 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:40 devstack sudo[75918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:11:40 devstack sudo[75918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:41 devstack sudo[75918]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:41 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:41 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:41 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:41 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:41 devstack sudo[75993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:11:41 devstack sudo[75993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:41 devstack sudo[75993]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:41 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:41 devstack cinder-volume[75203]: INFO cinder.volume.drivers.lvm [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 17 07:11:41 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:41 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:41 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:41 devstack sudo[75997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:11:41 devstack sudo[75997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:41 devstack sudo[75997]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:41 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:41 devstack cinder-volume[75203]: DEBUG cinder.volume.drivers.lvm [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Updating volume stats {{(pid=75203) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 07:11:41 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:41 devstack sudo[76000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:11:41 devstack sudo[76000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:42 devstack sudo[76000]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:42 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:42 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:42 devstack sudo[76009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:11:42 devstack sudo[76009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:42 devstack sudo[76009]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:42 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:42 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:42 devstack sudo[76012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:11:42 devstack sudo[76012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:42 devstack sudo[76012]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:42 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:42 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:42 devstack sudo[76016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:11:42 devstack sudo[76016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:42 devstack sudo[76016]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:42 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:42 devstack cinder-volume[75203]: INFO cinder.volume.driver [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Driver hasn't implemented _init_vendor_properties() Sep 17 07:11:42 devstack cinder-volume[75203]: DEBUG cinder.volume.driver [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75203) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 07:11:42 devstack cinder-volume[75203]: DEBUG oslo_db.sqlalchemy.engines [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75203) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 07:11:43 devstack cinder-volume[75203]: DEBUG dbcounter [-] [75203] Writer thread running {{(pid=75203) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 07:11:43 devstack cinder-volume[75203]: DEBUG cinder.db.api [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Building query based on filter {{(pid=75203) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 07:11:43 devstack cinder-volume[75203]: DEBUG cinder.image.image_utils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75203) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 17 07:11:43 devstack cinder-volume[75203]: INFO cinder.keymgr.migration [None req-b8e83f08-fedc-4e76-882e-65c817537e23 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 07:11:43 devstack cinder-volume[75203]: DEBUG cinder.volume.drivers.lvm [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Updating volume stats {{(pid=75203) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 07:11:43 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:43 devstack sudo[76019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:11:43 devstack sudo[76019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:43 devstack sudo[76019]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:43 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:43 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:43 devstack sudo[76024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:11:43 devstack sudo[76024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:43 devstack sudo[76024]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:43 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:43 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:43 devstack sudo[76027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:11:43 devstack sudo[76027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:43 devstack sudo[76027]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:43 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:43 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:43 devstack sudo[76030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:11:43 devstack sudo[76030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:44 devstack sudo[76030]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:44 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:44 devstack cinder-volume[75203]: DEBUG cinder.manager [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Notifying Schedulers of capabilities ... {{(pid=75203) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:11:44 devstack cinder-volume[75203]: INFO cinder.volume.manager [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Driver initialization completed successfully. Sep 17 07:11:44 devstack cinder-volume[75203]: INFO cinder.manager [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Initiating service 2 cleanup Sep 17 07:11:44 devstack cinder-volume[75203]: INFO cinder.manager [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Service 2 cleanup completed. Sep 17 07:11:44 devstack cinder-volume[75203]: DEBUG cinder.service [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Creating RPC server for service cinder-volume {{(pid=75203) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 07:11:44 devstack cinder-volume[75203]: DEBUG cinder.service [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75203) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 07:11:44 devstack cinder-volume[75203]: INFO cinder.volume.manager [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 17 07:11:44 devstack cinder-volume[75203]: DEBUG cinder.volume.drivers.lvm [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Updating volume stats {{(pid=75203) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 07:11:44 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:44 devstack sudo[76033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:11:44 devstack sudo[76033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:44 devstack sudo[76033]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:44 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:44 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:44 devstack sudo[76038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:11:44 devstack sudo[76038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:44 devstack sudo[76038]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:44 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:44 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:44 devstack sudo[76041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:11:44 devstack sudo[76041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:45 devstack sudo[76041]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:45 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:45 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:11:45 devstack sudo[76044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:11:45 devstack sudo[76044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:11:45 devstack sudo[76044]: pam_unix(sudo:session): session closed for user root Sep 17 07:11:45 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:11:45 devstack cinder-volume[75203]: INFO cinder.volume.manager [None req-e4bd1ebb-a146-4c07-94f6-32ccf915d2a9 None None] Driver post RPC initialization completed successfully. Sep 17 07:11:47 devstack cinder-volume[75013]: DEBUG dbcounter [-] [75013] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:11:55 devstack cinder-volume[75203]: DEBUG dbcounter [-] [75203] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75203) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:11:55 devstack cinder-volume[75203]: DEBUG dbcounter [-] [75203] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75203) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:12:21 devstack cinder-volume[75203]: DEBUG oslo_service.periodic_task [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running periodic task VolumeManager._thread_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:12:21 devstack cinder-volume[75203]: DEBUG cinder.volume.manager [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] thread count: 6 {{(pid=75203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:12:21 devstack cinder-volume[75203]: DEBUG cinder.volume.manager [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] thread info: [<_MainThread(MainThread, started 131830287040640)>, , , , , ] {{(pid=75203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:13:21 devstack cinder-volume[75203]: DEBUG oslo_service.periodic_task [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:13:21 devstack cinder-volume[75203]: DEBUG cinder.volume.drivers.lvm [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Updating volume stats {{(pid=75203) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 07:13:21 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:13:21 devstack sudo[81214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:13:21 devstack sudo[81214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:13:21 devstack sudo[81214]: pam_unix(sudo:session): session closed for user root Sep 17 07:13:21 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:13:21 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:13:21 devstack sudo[81217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:13:21 devstack sudo[81217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:13:22 devstack sudo[81217]: pam_unix(sudo:session): session closed for user root Sep 17 07:13:22 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:13:22 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:13:22 devstack sudo[81241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:13:22 devstack sudo[81241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:13:22 devstack sudo[81241]: pam_unix(sudo:session): session closed for user root Sep 17 07:13:22 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:13:22 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:13:22 devstack sudo[81247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:13:22 devstack sudo[81247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:13:22 devstack sudo[81247]: pam_unix(sudo:session): session closed for user root Sep 17 07:13:22 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:13:22 devstack cinder-volume[75203]: DEBUG cinder.manager [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Notifying Schedulers of capabilities ... {{(pid=75203) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:13:22 devstack cinder-volume[75203]: DEBUG oslo_service.periodic_task [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running periodic task VolumeManager._thread_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:13:22 devstack cinder-volume[75203]: DEBUG cinder.volume.manager [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] thread count: 6 {{(pid=75203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:13:22 devstack cinder-volume[75203]: DEBUG cinder.volume.manager [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] thread info: [<_MainThread(MainThread, started 131830287040640)>, , , , , ] {{(pid=75203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:13:55 devstack cinder-volume[75203]: DEBUG dbcounter [-] [75203] Writing DB stats cinder:SELECT=1 {{(pid=75203) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:13:55 devstack cinder-volume[75203]: DEBUG dbcounter [-] [75203] Writing DB stats cinder:UPDATE=1 {{(pid=75203) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:14:21 devstack cinder-volume[75203]: DEBUG oslo_service.periodic_task [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:14:21 devstack cinder-volume[75203]: DEBUG cinder.volume.drivers.lvm [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Updating volume stats {{(pid=75203) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 07:14:21 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:14:21 devstack sudo[82708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:14:21 devstack sudo[82708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:14:21 devstack sudo[82708]: pam_unix(sudo:session): session closed for user root Sep 17 07:14:21 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:14:21 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:14:21 devstack sudo[82711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:14:21 devstack sudo[82711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:14:22 devstack sudo[82711]: pam_unix(sudo:session): session closed for user root Sep 17 07:14:22 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:14:22 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:14:22 devstack sudo[82716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:14:22 devstack sudo[82716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:14:22 devstack sudo[82716]: pam_unix(sudo:session): session closed for user root Sep 17 07:14:22 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:14:22 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:14:22 devstack sudo[82719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:14:22 devstack sudo[82719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:14:22 devstack sudo[82719]: pam_unix(sudo:session): session closed for user root Sep 17 07:14:22 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:14:22 devstack cinder-volume[75203]: DEBUG cinder.manager [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Notifying Schedulers of capabilities ... {{(pid=75203) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:14:22 devstack cinder-volume[75203]: DEBUG oslo_service.periodic_task [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running periodic task VolumeManager._thread_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:14:22 devstack cinder-volume[75203]: DEBUG cinder.volume.manager [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] thread count: 6 {{(pid=75203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:14:22 devstack cinder-volume[75203]: DEBUG cinder.volume.manager [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] thread info: [<_MainThread(MainThread, started 131830287040640)>, , , , , ] {{(pid=75203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:15:21 devstack cinder-volume[75203]: DEBUG oslo_service.periodic_task [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:15:21 devstack cinder-volume[75203]: DEBUG cinder.volume.drivers.lvm [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Updating volume stats {{(pid=75203) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 07:15:21 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:15:21 devstack sudo[84227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:15:21 devstack sudo[84227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:21 devstack sudo[84227]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:21 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:15:21 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:15:21 devstack sudo[84230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:15:21 devstack sudo[84230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:21 devstack sudo[84230]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:21 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:15:21 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:15:22 devstack sudo[84233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:15:22 devstack sudo[84233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:22 devstack sudo[84233]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:22 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:15:22 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:15:22 devstack sudo[84239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:15:22 devstack sudo[84239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:22 devstack sudo[84239]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:22 devstack cinder-volume[75203]: DEBUG oslo_concurrency.processutils [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:15:22 devstack cinder-volume[75203]: DEBUG cinder.manager [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Notifying Schedulers of capabilities ... {{(pid=75203) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:15:22 devstack cinder-volume[75203]: DEBUG oslo_service.periodic_task [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] Running periodic task VolumeManager._thread_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:15:22 devstack cinder-volume[75203]: DEBUG cinder.volume.manager [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] thread count: 6 {{(pid=75203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:15:22 devstack cinder-volume[75203]: DEBUG cinder.volume.manager [None req-81661f06-818a-4dcd-817d-3a3076ff7b6a None None] thread info: [<_MainThread(MainThread, started 131830287040640)>, , , , , ] {{(pid=75203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:15:55 devstack cinder-volume[75203]: DEBUG dbcounter [-] [75203] Writing DB stats cinder:SELECT=1 {{(pid=75203) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:15:55 devstack cinder-volume[75203]: DEBUG dbcounter [-] [75203] Writing DB stats cinder:UPDATE=1 {{(pid=75203) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:16:06 devstack cinder-volume[75013]: INFO oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Caught SIGTERM, stopping children Sep 17 07:16:06 devstack cinder-volume[75013]: DEBUG oslo_concurrency.lockutils [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Acquiring lock "singleton_lock" {{(pid=75013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 07:16:06 devstack cinder-volume[75013]: DEBUG oslo_concurrency.lockutils [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Acquired lock "singleton_lock" {{(pid=75013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 07:16:06 devstack cinder-volume[75013]: DEBUG oslo_concurrency.lockutils [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Releasing lock "singleton_lock" {{(pid=75013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 07:16:06 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Stop services. {{(pid=75013) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 17 07:16:06 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Killing children. {{(pid=75013) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 17 07:16:06 devstack cinder-volume[75013]: INFO oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Waiting on 1 children to exit Sep 17 07:16:09 devstack cinder-volume[75203]: DEBUG oslo_concurrency.lockutils [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Acquiring lock "singleton_lock" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 07:16:09 devstack cinder-volume[75203]: DEBUG oslo_concurrency.lockutils [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Acquired lock "singleton_lock" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 07:16:09 devstack cinder-volume[75203]: DEBUG oslo_concurrency.lockutils [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Releasing lock "singleton_lock" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 07:16:09 devstack cinder-volume[75203]: WARNING amqp [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 07:16:09 devstack cinder-volume[75203]: WARNING amqp [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 07:16:09 devstack cinder-volume[75013]: INFO oslo_service.backend._eventlet.service [None req-44512621-e88c-46e6-96f2-eb689e3f2f89 None None] Child 75203 exited with status 0 Sep 17 07:16:09 devstack cinder-volume[85183]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 07:16:09 devstack cinder-volume[85183]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 07:16:09 devstack cinder-volume[85183]: we strongly recommend against using it for new projects. Sep 17 07:16:09 devstack cinder-volume[85183]: If you are already using Eventlet, we recommend migrating to a different Sep 17 07:16:09 devstack cinder-volume[85183]: framework. For more detail see Sep 17 07:16:09 devstack cinder-volume[85183]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 07:16:09 devstack cinder-volume[85183]: import eventlet # noqa Sep 17 07:16:11 devstack cinder-volume[85183]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85183) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 07:16:11 devstack cinder-volume[85183]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85183) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 07:16:11 devstack cinder-volume[85183]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85183) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 07:16:12 devstack cinder-volume[85183]: INFO dbcounter [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Registered counter for database cinder Sep 17 07:16:12 devstack cinder-volume[85183]: DEBUG oslo_db.sqlalchemy.engines [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85183) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 07:16:12 devstack cinder-volume[85183]: DEBUG dbcounter [-] [85183] Writer thread running {{(pid=85183) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 07:16:12 devstack cinder-volume[85183]: INFO cinder.rpc [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 07:16:12 devstack cinder-volume[85183]: INFO cinder.rpc [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 07:16:12 devstack cinder-volume[85183]: DEBUG oslo_db.sqlalchemy.engines [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85183) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 07:16:13 devstack cinder-volume[85183]: INFO cinder.volume.manager [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Determined volume DB was empty at startup. Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG cinder.volume.manager [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85183) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 07:16:13 devstack cinder-volume[85183]: INFO cinder.volume.manager [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 07:16:13 devstack cinder-volume[85183]: WARNING stevedore.named [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 07:16:13 devstack cinder-volume[85183]: WARNING castellan.key_manager [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 07:16:13 devstack cinder-volume[85183]: WARNING cinder.keymgr.conf_key_mgr [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 07:16:13 devstack cinder-volume[85183]: INFO cinder.volume.manager [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_db.sqlalchemy.engines [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85183) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 07:16:13 devstack cinder-volume[85183]: INFO oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Starting 1 workers Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Started child 85395 {{(pid=85183) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Full set of CONF: {{(pid=85183) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] ******************************************************************************** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Configuration options gathered from: {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] ================================================================================ {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] allow_availability_zone_fallback = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] allow_compression_on_image_upload = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] allowed_direct_url_schemes = [] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] api_rate_limit = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] auth_strategy = keystone {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_availability_zone = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_host = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_name = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_stats_polling_interval = 60 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backup_api_class = cinder.backup.api.API {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backup_name_template = backup-%s {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backup_use_same_host = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backup_use_temp_snapshot = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] chap_password = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] chap_username = {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cinder_internal_tenant_project_id = 3d4e04f7040f47b1b3f1d7683ca494e9 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cinder_internal_tenant_user_id = f165d006610f424cac118574fc11d572 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cluster = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] compression_format = gzip {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] compute_api_class = cinder.compute.nova.API {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] config_dir = [] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] config_source = [] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] control_exchange = openstack {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] debug = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] default_availability_zone = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] default_group_type = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] default_volume_type = QuobyteHD {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] disk_geometry = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] driver_client_cert = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] driver_client_cert_key = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85395]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] driver_data_namespace = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] driver_ssl_cert_path = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] driver_ssl_cert_verify = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] driver_use_ssl = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] enable_new_services = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] enable_unsupported_driver = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] enabled_backends = ['QuobyteHD'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] enforce_multipath_for_image_xfer = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] filter_function = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance_api_insecure = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance_api_servers = ['http://192.168.122.16/image'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance_api_ssl_compression = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance_ca_certificates_file = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance_catalog_info = image:glance:publicURL {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance_certfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance_keyfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance_num_retries = 3 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance_request_timeout = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] goodness_function = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] graceful_shutdown_timeout = 5 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] group_api_class = cinder.group.api.API {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] host = devstack {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] image_compress_on_upload = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] image_conversion_address_space_limit = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] image_conversion_cpu_limit = 60 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] image_conversion_disable = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] image_introspection_address_space_limit = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] image_introspection_cpu_limit = 60 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] image_upload_use_cinder_backend = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] image_upload_use_internal_tenant = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] image_volume_cache_enabled = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] image_volume_cache_max_count = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] image_volume_cache_max_size_gb = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] init_host_max_objects_retrieval = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] instance_format = [instance: %(uuid)s] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] iscsi_target_flags = {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] iscsi_write_cache = on {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] iser_helper = tgtadm {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] iser_ip_address = 192.168.122.16 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] iser_port = 3260 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] log_color = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] log_config_append = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] log_dir = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] log_file = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] log_options = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] log_rotate_interval = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] log_rotate_interval_type = days {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] log_rotation_type = none {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] max_age = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] max_logfile_count = 30 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] max_logfile_size_mb = 200 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] max_over_subscription_ratio = 20.0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] message_reap_interval = 86400 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] message_ttl = 2592000 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] migration_create_volume_timeout_secs = 300 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] monkey_patch = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] monkey_patch_modules = [] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] my_ip = 192.168.122.16 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] no_snapshot_gb_quota = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] num_iser_scan_tries = 3 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] num_shell_tries = 3 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] num_volume_device_scan_tries = 3 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] nvmeof_conn_info_version = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] nvmet_ns_id = 10 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] nvmet_port_id = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] osapi_max_limit = 1000 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] osapi_volume_ext_list = [] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] osapi_volume_listen_port = 8776 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] osapi_volume_use_ssl = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] osapi_volume_workers = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] per_volume_size_limit = -1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] periodic_fuzzy_delay = 60 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] periodic_interval = 60 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] public_endpoint = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] publish_errors = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] quota_backup_gigabytes = 1000 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] quota_backups = 10 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] quota_gigabytes = 1000 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] quota_groups = 10 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] quota_snapshots = 10 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] quota_volumes = 10 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] rate_limit_burst = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] rate_limit_except_level = CRITICAL {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] rate_limit_interval = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] reinit_driver_count = 3 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] replication_device = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] report_discard_supported = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] report_interval = 120 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] reservation_clean_interval = 86400 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] reservation_expire = 86400 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] reserved_image_namespaces = [] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] reserved_percentage = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] rpc_response_timeout = 120 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] run_external_periodic_tasks = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] scst_target_driver = iscsi {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] scst_target_iqn_name = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] service_down_time = 720 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85395]: INFO cinder.volume.manager [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 17 07:16:13 devstack cinder-volume[85395]: DEBUG cinder.volume.drivers.remotefs [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85395) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] shell_completion = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] snapshot_name_template = snapshot-%s {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] split_loggers = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] state_path = /opt/stack/data/cinder {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] storage_availability_zone = nova {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] storage_protocol = iSCSI {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] syslog_log_facility = LOG_USER {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] target_helper = lioadm {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] target_ip_address = 192.168.122.16 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] target_port = 3260 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] target_protocol = iscsi {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] target_secondary_ip_addresses = [] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] trace_flags = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] transport_url = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] until_refresh = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] use_chap_auth = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] use_default_quota_class = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] use_journal = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] use_json = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] use_multipath_for_image_xfer = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] use_stderr = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] use_syslog = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] verify_glance_signatures = enabled {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] volume_api_class = cinder.volume.api.API {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] volume_backend_name = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] volume_clear = zero {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] volume_clear_ionice = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] volume_clear_size = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] volume_copy_bps_limit = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] volume_dd_blocksize = 1M {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] volume_name_template = volume-%s {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] volume_service_inithost_offload = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] volume_usage_audit_period = month {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] zoning_mode = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_concurrency.disable_process_locking = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.auth_section = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.auth_type = password {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.auth_version = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.cache = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.certfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.include_service_catalog = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.insecure = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.interface = public {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.keyfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_password = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcache_username = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.region_name = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.service_type = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.backend = dogpile.cache.null {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.backend_argument = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.backend_expiration_time = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.config_prefix = cache.oslo {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.debug_cache_backend = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.enable_retry_client = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.enable_socket_keepalive = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.enabled = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.expiration_time = 600 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.hashclient_retry_attempts = 2 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.memcache_dead_retry = 300 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.memcache_pool_maxsize = 10 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.memcache_sasl_enabled = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.password = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.proxies = [] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.redis_db = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.redis_server = localhost:6379 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.retry_attempts = 2 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.retry_delay = 0.0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.socket_keepalive_count = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.socket_keepalive_idle = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.socket_keepalive_interval = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.socket_timeout = 1.0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.tls_allowed_ciphers = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.tls_cafile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.tls_certfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.tls_enabled = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.tls_keyfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cache.username = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] coordination.backend_url = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.asyncio_connection = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.asyncio_slave_connection = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.backend = sqlalchemy {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.connection = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.connection_debug = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.connection_parameters = {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.connection_recycle_time = 3600 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.connection_trace = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.db_inc_retry_interval = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.db_max_retries = 20 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.db_max_retry_interval = 10 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.db_retry_interval = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.max_overflow = 50 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.max_pool_size = 5 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.max_retries = 10 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.mysql_wsrep_sync_wait = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.pool_timeout = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.retry_interval = 10 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.slave_connection = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.sqlite_synchronous = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.synchronous_reader = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] database.use_db_reconnect = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_tracing.insecure = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] profiler.connection_string = messaging:// {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] profiler.enabled = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] profiler.es_doc_type = notification {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] profiler.es_scroll_size = 10000 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] profiler.es_scroll_time = 2m {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85395]: DEBUG cinder.volume.drivers.quobyte [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85395) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 17 07:16:13 devstack cinder-volume[85395]: WARNING cinder.volume.drivers.quobyte [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 17 07:16:13 devstack cinder-volume[85395]: WARNING cinder.volume.drivers.quobyte [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 17 07:16:13 devstack cinder-volume[85395]: DEBUG oslo_concurrency.processutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Running cmd (subprocess): mount.quobyte {{(pid=85395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] profiler.filter_error_trace = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] profiler.hmac_keys = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] profiler.sentinel_service_name = mymaster {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] profiler.socket_timeout = 0.1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] profiler.trace_requests = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] profiler.trace_sqlalchemy = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] profiler_jaeger.process_tags = {} {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] profiler_jaeger.service_name_prefix = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] profiler_otlp.service_name_prefix = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_policy.enforce_new_defaults = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_policy.policy_default_rule = default {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_policy.policy_file = policy.yaml {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] privsep_osbrick.group = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] privsep_osbrick.helper_command = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] privsep_osbrick.user = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cinder_sys_admin.group = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cinder_sys_admin.helper_command = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] cinder_sys_admin.user = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] service_user.auth_section = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] service_user.auth_type = password {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] service_user.cafile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] service_user.certfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] service_user.collect_timing = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] service_user.insecure = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] service_user.keyfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] service_user.send_service_user_token = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] service_user.split_loggers = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] service_user.timeout = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] service_user.tls_ciphers = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] service_user.tls_min_version = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance.auth_section = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance.auth_type = password {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance.certfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance.collect_timing = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance.insecure = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance.keyfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance.region_name = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance.split_loggers = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance.timeout = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance.tls_ciphers = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] glance.tls_min_version = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.backend_availability_zone = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.chap_password = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.chap_username = {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.disk_geometry = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.driver_client_cert = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.driver_client_cert_key = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.driver_data_namespace = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.driver_use_ssl = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.extra_capabilities = {} {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.filter_function = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.goodness_function = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.iscsi_target_flags = {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.iscsi_write_cache = on {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.iser_helper = tgtadm {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.iser_port = 3260 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.nas_host = {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.nas_login = admin {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.nas_mount_options = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.nas_password = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.nas_private_key = {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.nas_share_path = {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.num_shell_tries = 3 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.quobyte_volume_url = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.replication_device = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.report_discard_supported = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.reserved_percentage = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.target_helper = tgtadm {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.target_port = 3260 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.target_protocol = iscsi {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.trace_flags = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.unique_fqdn_network = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.use_chap_auth = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.volume_backend_name = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.volume_clear = zero {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.volume_clear_ionice = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.volume_clear_size = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_reports.file_event_handler = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_reports.log_dir = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.backend_availability_zone = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.backend_host = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.chap_password = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.chap_username = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.chiscsi_conf = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.disk_geometry = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.driver_client_cert = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.driver_data_namespace = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.driver_use_ssl = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.extra_capabilities = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.filter_function = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.goodness_function = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.iser_helper = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.iser_ip_address = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.iser_port = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.iser_target_prefix = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.nas_host = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.nas_login = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.nas_mount_options = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.nas_password = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.nas_private_key = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.nas_share_path = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.nas_ssh_port = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.num_shell_tries = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.nvmet_port_id = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.replication_device = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.report_discard_supported = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.reserved_percentage = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.scst_target_driver = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.storage_protocol = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.target_helper = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.target_ip_address = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.target_port = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.target_prefix = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.target_protocol = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.trace_flags = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.use_chap_auth = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.volume_clear = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.volume_clear_size = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] QuobyteHD.volumes_dir = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack quobyte-client[85400]: Reading configuration file: /etc/quobyte/client.cfg Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.ssl = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack quobyte-client[85400]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_notifications.driver = [] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_notifications.retry = -1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] key_manager.fixed_key = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.barbican_api_version = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.barbican_endpoint = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.barbican_endpoint_type = public {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.barbican_region_name = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.cafile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.certfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.collect_timing = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.insecure = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.keyfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.number_of_retries = 60 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.retry_delay = 1 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.send_service_user_token = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.split_loggers = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.timeout = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.tls_ciphers = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.tls_min_version = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.verify_ssl = True {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican.verify_ssl_path = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican_service_user.auth_section = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican_service_user.auth_type = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican_service_user.cafile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican_service_user.certfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican_service_user.collect_timing = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican_service_user.insecure = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican_service_user.keyfile = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican_service_user.split_loggers = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican_service_user.timeout = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican_service_user.tls_ciphers = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] barbican_service_user.tls_min_version = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.approle_role_id = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.approle_secret_id = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.auth_method = approle {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.auth_path = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.kv_mountpoint = secret {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.kv_path = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.kv_version = 2 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.namespace = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.root_token_id = **** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.ssl_ca_crt_file = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.timeout = 60.0 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.token_file = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.token_role = None {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.use_ssl = False {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:13 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] ******************************************************************************** {{(pid=85183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 07:16:13 devstack cinder-volume[85395]: DEBUG oslo_concurrency.processutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] CMD "mount.quobyte" returned: 1 in 0.119s {{(pid=85395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:16:13 devstack cinder-volume[85395]: DEBUG oslo_concurrency.lockutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85395) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:16:13 devstack cinder-volume[85395]: DEBUG oslo_concurrency.lockutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85395) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:16:13 devstack cinder-volume[85395]: DEBUG cinder.volume.drivers.quobyte [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=85395) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:16:13 devstack cinder-volume[85395]: INFO cinder.volume.drivers.quobyte [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 ... Sep 17 07:16:13 devstack cinder-volume[85395]: DEBUG oslo_concurrency.processutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb -c /etc/quobyte/client-cinder.cfg {{(pid=85395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:16:13 devstack sudo[85401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb -c /etc/quobyte/client-cinder.cfg Sep 17 07:16:13 devstack sudo[85401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:16:13 devstack sudo[85401]: pam_unix(sudo:session): session closed for user root Sep 17 07:16:13 devstack cinder-volume[85395]: DEBUG oslo_concurrency.processutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.376s {{(pid=85395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:16:13 devstack cinder-volume[85395]: INFO cinder.volume.drivers.quobyte [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 succeeded Sep 17 07:16:13 devstack cinder-volume[85395]: DEBUG cinder.volume.drivers.quobyte [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=85395) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:16:13 devstack cinder-volume[85395]: DEBUG oslo_concurrency.lockutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.405s {{(pid=85395) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:16:13 devstack cinder-volume[85395]: DEBUG oslo_concurrency.processutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=85395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:16:13 devstack sudo[85500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:16:13 devstack sudo[85500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:16:14 devstack sudo[85500]: pam_unix(sudo:session): session closed for user root Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG oslo_concurrency.processutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.243s {{(pid=85395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:16:14 devstack cinder-volume[85395]: INFO cinder.volume.driver [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Driver hasn't implemented _init_vendor_properties() Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG cinder.volume.driver [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8438682556152, 'free_capacity_gb': 1775.8438682556152, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85395) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG oslo_db.sqlalchemy.engines [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG dbcounter [-] [85395] Writer thread running {{(pid=85395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG cinder.db.api [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Building query based on filter {{(pid=85395) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG cinder.image.image_utils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85395) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 17 07:16:14 devstack cinder-volume[85395]: INFO cinder.keymgr.migration [None req-46e3098c-aa26-4e2a-a2db-aa34b2299fa3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG oslo_concurrency.lockutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85395) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG oslo_concurrency.lockutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85395) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG cinder.volume.drivers.quobyte [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=85395) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG cinder.volume.drivers.quobyte [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=85395) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG oslo_concurrency.lockutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85395) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG oslo_concurrency.processutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=85395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:16:14 devstack sudo[85503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:16:14 devstack sudo[85503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:16:14 devstack sudo[85503]: pam_unix(sudo:session): session closed for user root Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG oslo_concurrency.processutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.235s {{(pid=85395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG cinder.manager [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Notifying Schedulers of capabilities ... {{(pid=85395) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:16:14 devstack cinder-volume[85395]: INFO cinder.volume.manager [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Driver initialization completed successfully. Sep 17 07:16:14 devstack cinder-volume[85395]: INFO cinder.manager [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Initiating service 3 cleanup Sep 17 07:16:14 devstack cinder-volume[85395]: INFO cinder.manager [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Service 3 cleanup completed. Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG cinder.service [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Creating RPC server for service cinder-volume {{(pid=85395) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG cinder.service [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85395) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 07:16:14 devstack cinder-volume[85395]: INFO cinder.volume.manager [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG oslo_concurrency.lockutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85395) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG oslo_concurrency.lockutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85395) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG cinder.volume.drivers.quobyte [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=85395) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG cinder.volume.drivers.quobyte [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=85395) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG oslo_concurrency.lockutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85395) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG oslo_concurrency.processutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=85395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:16:14 devstack sudo[85506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:16:14 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:16:14 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root Sep 17 07:16:14 devstack cinder-volume[85395]: DEBUG oslo_concurrency.processutils [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.247s {{(pid=85395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:16:15 devstack cinder-volume[85395]: INFO cinder.volume.manager [None req-468bd847-408a-4ee1-9465-163fb855d297 None None] Driver post RPC initialization completed successfully. Sep 17 07:16:18 devstack cinder-volume[85183]: INFO oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Caught SIGTERM, stopping children Sep 17 07:16:18 devstack cinder-volume[85183]: DEBUG oslo_concurrency.lockutils [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Acquiring lock "singleton_lock" {{(pid=85183) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 07:16:18 devstack cinder-volume[85183]: DEBUG oslo_concurrency.lockutils [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Acquired lock "singleton_lock" {{(pid=85183) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 07:16:18 devstack cinder-volume[85183]: DEBUG oslo_concurrency.lockutils [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Releasing lock "singleton_lock" {{(pid=85183) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 07:16:18 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Stop services. {{(pid=85183) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 17 07:16:18 devstack cinder-volume[85183]: DEBUG oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Killing children. {{(pid=85183) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 17 07:16:18 devstack cinder-volume[85183]: INFO oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Waiting on 1 children to exit Sep 17 07:16:22 devstack cinder-volume[85395]: DEBUG oslo_concurrency.lockutils [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Acquiring lock "singleton_lock" {{(pid=85395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 07:16:22 devstack cinder-volume[85395]: DEBUG oslo_concurrency.lockutils [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Acquired lock "singleton_lock" {{(pid=85395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 07:16:22 devstack cinder-volume[85395]: DEBUG oslo_concurrency.lockutils [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Releasing lock "singleton_lock" {{(pid=85395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 07:16:22 devstack cinder-volume[85395]: WARNING amqp [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 07:16:23 devstack cinder-volume[85395]: WARNING amqp [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 07:16:23 devstack cinder-volume[85183]: INFO oslo_service.backend._eventlet.service [None req-31d174b7-725c-49b3-8118-0ab7d337aab8 None None] Child 85395 exited with status 0 Sep 17 07:16:23 devstack cinder-volume[85731]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 07:16:23 devstack cinder-volume[85731]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 07:16:23 devstack cinder-volume[85731]: we strongly recommend against using it for new projects. Sep 17 07:16:23 devstack cinder-volume[85731]: If you are already using Eventlet, we recommend migrating to a different Sep 17 07:16:23 devstack cinder-volume[85731]: framework. For more detail see Sep 17 07:16:23 devstack cinder-volume[85731]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 07:16:23 devstack cinder-volume[85731]: import eventlet # noqa Sep 17 07:16:26 devstack cinder-volume[85731]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 07:16:26 devstack cinder-volume[85731]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 07:16:26 devstack cinder-volume[85731]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 07:16:26 devstack cinder-volume[85731]: INFO dbcounter [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] Registered counter for database cinder Sep 17 07:16:26 devstack cinder-volume[85731]: DEBUG oslo_db.sqlalchemy.engines [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG dbcounter [-] [85731] Writer thread running {{(pid=85731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 07:16:27 devstack cinder-volume[85731]: INFO cinder.rpc [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 07:16:27 devstack cinder-volume[85731]: INFO cinder.rpc [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_db.sqlalchemy.engines [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 07:16:27 devstack cinder-volume[85731]: INFO cinder.volume.manager [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] Determined volume DB was empty at startup. Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG cinder.volume.manager [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85731) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 07:16:27 devstack cinder-volume[85731]: WARNING stevedore.named [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 07:16:27 devstack cinder-volume[85731]: WARNING castellan.key_manager [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 07:16:27 devstack cinder-volume[85731]: WARNING cinder.keymgr.conf_key_mgr [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 07:16:27 devstack cinder-volume[85731]: INFO cinder.volume.manager [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_db.sqlalchemy.engines [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 07:16:27 devstack cinder-volume[85731]: INFO oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] Starting 1 workers Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] Started child 86029 {{(pid=85731) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] Full set of CONF: {{(pid=85731) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] ******************************************************************************** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] Configuration options gathered from: {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 07:16:27 devstack cinder-volume[86029]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] ================================================================================ {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] allow_availability_zone_fallback = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] allow_compression_on_image_upload = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] allowed_direct_url_schemes = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] api_rate_limit = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] auth_strategy = keystone {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_availability_zone = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_host = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_stats_polling_interval = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backup_api_class = cinder.backup.api.API {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backup_name_template = backup-%s {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backup_use_same_host = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backup_use_temp_snapshot = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] chap_password = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] chap_username = {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cinder_internal_tenant_project_id = 3d4e04f7040f47b1b3f1d7683ca494e9 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cinder_internal_tenant_user_id = f165d006610f424cac118574fc11d572 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cluster = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] compression_format = gzip {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] compute_api_class = cinder.compute.nova.API {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] config_dir = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] config_source = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] control_exchange = openstack {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] debug = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] default_availability_zone = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] default_group_type = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] default_volume_type = QuobyteHD {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] disk_geometry = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] driver_client_cert = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] driver_client_cert_key = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] driver_data_namespace = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] driver_ssl_cert_path = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] driver_ssl_cert_verify = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] driver_use_ssl = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] enable_new_services = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] enable_unsupported_driver = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] enabled_backends = ['QuobyteHD'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] enforce_multipath_for_image_xfer = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] filter_function = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance_api_insecure = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance_api_servers = ['http://192.168.122.16/image'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance_api_ssl_compression = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance_ca_certificates_file = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance_catalog_info = image:glance:publicURL {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance_certfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance_keyfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance_num_retries = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance_request_timeout = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] goodness_function = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] graceful_shutdown_timeout = 5 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] group_api_class = cinder.group.api.API {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] host = devstack {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] image_compress_on_upload = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] image_conversion_address_space_limit = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] image_conversion_cpu_limit = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] image_conversion_disable = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] image_introspection_address_space_limit = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] image_introspection_cpu_limit = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] image_upload_use_cinder_backend = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] image_upload_use_internal_tenant = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] image_volume_cache_enabled = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] image_volume_cache_max_count = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] image_volume_cache_max_size_gb = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] init_host_max_objects_retrieval = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] instance_format = [instance: %(uuid)s] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] iscsi_target_flags = {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] iscsi_write_cache = on {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] iser_helper = tgtadm {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] iser_ip_address = 192.168.122.16 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] iser_port = 3260 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] log_color = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] log_config_append = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] log_dir = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] log_file = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] log_options = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] log_rotate_interval = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] log_rotate_interval_type = days {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] log_rotation_type = none {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] max_age = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] max_logfile_count = 30 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] max_logfile_size_mb = 200 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] max_over_subscription_ratio = 20.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] message_reap_interval = 86400 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] message_ttl = 2592000 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] migration_create_volume_timeout_secs = 300 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] monkey_patch = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] monkey_patch_modules = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] my_ip = 192.168.122.16 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] no_snapshot_gb_quota = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] num_iser_scan_tries = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] num_shell_tries = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] num_volume_device_scan_tries = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] nvmeof_conn_info_version = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] nvmet_ns_id = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] nvmet_port_id = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] osapi_max_limit = 1000 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] osapi_volume_ext_list = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] osapi_volume_listen_port = 8776 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] osapi_volume_use_ssl = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] osapi_volume_workers = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] per_volume_size_limit = -1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] periodic_fuzzy_delay = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] periodic_interval = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] public_endpoint = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] publish_errors = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] quota_backup_gigabytes = 1000 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] quota_backups = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] quota_gigabytes = 1000 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] quota_groups = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] quota_snapshots = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] quota_volumes = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] rate_limit_burst = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] rate_limit_except_level = CRITICAL {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Starting volume driver QuobyteDriver (1.2.1) Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] rate_limit_interval = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] reinit_driver_count = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86029) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] replication_device = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] report_discard_supported = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] report_interval = 120 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] reservation_clean_interval = 86400 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] reservation_expire = 86400 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] reserved_image_namespaces = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] reserved_percentage = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] rpc_response_timeout = 120 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] run_external_periodic_tasks = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] scst_target_driver = iscsi {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] scst_target_iqn_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] service_down_time = 720 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] shell_completion = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] snapshot_name_template = snapshot-%s {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] split_loggers = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] state_path = /opt/stack/data/cinder {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] storage_availability_zone = nova {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] storage_protocol = iSCSI {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] syslog_log_facility = LOG_USER {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] target_helper = lioadm {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] target_ip_address = 192.168.122.16 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] target_port = 3260 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] target_protocol = iscsi {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] target_secondary_ip_addresses = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] trace_flags = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] transport_url = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] until_refresh = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] use_chap_auth = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] use_default_quota_class = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] use_journal = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] use_json = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] use_multipath_for_image_xfer = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] use_stderr = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] use_syslog = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] verify_glance_signatures = enabled {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] volume_api_class = cinder.volume.api.API {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] volume_backend_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] volume_clear = zero {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] volume_clear_ionice = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] volume_clear_size = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] volume_copy_bps_limit = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] volume_dd_blocksize = 1M {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] volume_name_template = volume-%s {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] volume_service_inithost_offload = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] volume_usage_audit_period = month {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] zoning_mode = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_concurrency.disable_process_locking = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.auth_section = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.auth_type = password {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.auth_version = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.cache = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.certfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.include_service_catalog = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.insecure = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.interface = public {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.keyfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_password = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcache_username = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.region_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.service_type = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.backend = dogpile.cache.null {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.backend_argument = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.backend_expiration_time = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.config_prefix = cache.oslo {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.debug_cache_backend = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.enable_retry_client = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.enable_socket_keepalive = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.enabled = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.expiration_time = 600 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.hashclient_retry_attempts = 2 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.memcache_dead_retry = 300 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.memcache_pool_maxsize = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.memcache_sasl_enabled = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.password = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.proxies = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.redis_db = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.redis_server = localhost:6379 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.retry_attempts = 2 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.retry_delay = 0.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.socket_keepalive_count = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.socket_keepalive_idle = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.socket_keepalive_interval = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.socket_timeout = 1.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.tls_allowed_ciphers = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.tls_cafile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.tls_certfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.tls_enabled = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.tls_keyfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cache.username = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] coordination.backend_url = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.asyncio_connection = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.asyncio_slave_connection = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.backend = sqlalchemy {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.connection = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.connection_debug = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.connection_parameters = {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.connection_recycle_time = 3600 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.connection_trace = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.db_inc_retry_interval = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.db_max_retries = 20 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.db_max_retry_interval = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.db_retry_interval = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.max_overflow = 50 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.max_pool_size = 5 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.max_retries = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.mysql_wsrep_sync_wait = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.pool_timeout = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.retry_interval = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.slave_connection = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.sqlite_synchronous = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.synchronous_reader = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] database.use_db_reconnect = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_tracing.insecure = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] profiler.connection_string = messaging:// {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] profiler.enabled = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] profiler.es_doc_type = notification {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] profiler.es_scroll_size = 10000 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] profiler.es_scroll_time = 2m {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] profiler.filter_error_trace = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] profiler.hmac_keys = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] profiler.sentinel_service_name = mymaster {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] profiler.socket_timeout = 0.1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] profiler.trace_requests = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] profiler.trace_sqlalchemy = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] profiler_jaeger.process_tags = {} {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] profiler_jaeger.service_name_prefix = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] profiler_otlp.service_name_prefix = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_policy.enforce_new_defaults = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_policy.policy_default_rule = default {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_policy.policy_file = policy.yaml {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] privsep_osbrick.group = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] privsep_osbrick.helper_command = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] privsep_osbrick.user = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cinder_sys_admin.group = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cinder_sys_admin.helper_command = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86029) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.quobyte [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] cinder_sys_admin.user = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.quobyte [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] service_user.auth_section = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] service_user.auth_type = password {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] service_user.cafile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] service_user.certfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Running cmd (subprocess): mount.quobyte {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] service_user.collect_timing = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] service_user.insecure = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] service_user.keyfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] service_user.send_service_user_token = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] service_user.split_loggers = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] service_user.timeout = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] service_user.tls_ciphers = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] service_user.tls_min_version = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance.auth_section = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance.auth_type = password {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance.certfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance.collect_timing = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance.insecure = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance.keyfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance.region_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance.split_loggers = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance.timeout = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance.tls_ciphers = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] glance.tls_min_version = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.backend_availability_zone = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.chap_password = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.chap_username = {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.disk_geometry = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.driver_client_cert = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.driver_client_cert_key = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.driver_data_namespace = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.driver_use_ssl = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.extra_capabilities = {} {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.filter_function = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.goodness_function = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.iscsi_target_flags = {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.iscsi_write_cache = on {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.iser_helper = tgtadm {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.iser_port = 3260 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.nas_host = {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.nas_login = admin {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.nas_mount_options = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.nas_password = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.nas_private_key = {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.nas_share_path = {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.num_shell_tries = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.quobyte_volume_url = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.replication_device = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.report_discard_supported = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.reserved_percentage = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.target_helper = tgtadm {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.target_port = 3260 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.target_protocol = iscsi {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.trace_flags = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.unique_fqdn_network = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.use_chap_auth = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.volume_backend_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.volume_clear = zero {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.volume_clear_ionice = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.volume_clear_size = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_reports.file_event_handler = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_reports.log_dir = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.backend_availability_zone = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.backend_host = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.chap_password = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.chap_username = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.chiscsi_conf = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.disk_geometry = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.driver_client_cert = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.driver_data_namespace = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.driver_use_ssl = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.extra_capabilities = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.filter_function = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.goodness_function = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.iser_helper = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.iser_ip_address = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.iser_port = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.iser_target_prefix = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.nas_host = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.nas_login = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.nas_mount_options = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.nas_password = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.nas_private_key = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.nas_share_path = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.nas_ssh_port = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.num_shell_tries = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.nvmet_port_id = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.replication_device = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.report_discard_supported = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.reserved_percentage = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.scst_target_driver = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.storage_protocol = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack quobyte-client[86032]: Reading configuration file: /etc/quobyte/client.cfg Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.target_helper = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.target_ip_address = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.target_port = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.target_prefix = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.target_protocol = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.trace_flags = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack quobyte-client[86032]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 17 07:16:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.use_chap_auth = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:16:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.volume_clear = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.volume_clear_size = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] QuobyteHD.volumes_dir = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.ssl = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_notifications.driver = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_notifications.retry = -1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] key_manager.fixed_key = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.barbican_api_version = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.barbican_endpoint = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.barbican_endpoint_type = public {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.barbican_region_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.cafile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.certfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.collect_timing = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.insecure = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.keyfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.number_of_retries = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.retry_delay = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.send_service_user_token = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.split_loggers = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.timeout = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.tls_ciphers = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.tls_min_version = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.verify_ssl = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican.verify_ssl_path = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican_service_user.auth_section = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican_service_user.auth_type = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican_service_user.cafile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican_service_user.certfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican_service_user.collect_timing = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican_service_user.insecure = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican_service_user.keyfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican_service_user.split_loggers = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican_service_user.timeout = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican_service_user.tls_ciphers = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] barbican_service_user.tls_min_version = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.approle_role_id = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.approle_secret_id = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.auth_method = approle {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.auth_path = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.kv_mountpoint = secret {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.kv_path = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.kv_version = 2 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.namespace = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.root_token_id = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.ssl_ca_crt_file = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.timeout = 60.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.token_file = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.token_role = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.use_ssl = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 07:16:27 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-6238cf3e-3866-4806-bd77-7bf2933ed8b5 None None] ******************************************************************************** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 07:16:27 devstack sudo[86039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:16:27 devstack sudo[86039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:16:27 devstack sudo[86039]: pam_unix(sudo:session): session closed for user root Sep 17 07:16:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.260s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:16:27 devstack cinder-volume[86029]: INFO cinder.volume.driver [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Driver hasn't implemented _init_vendor_properties() Sep 17 07:16:27 devstack cinder-volume[86029]: DEBUG cinder.volume.driver [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8438682556152, 'free_capacity_gb': 1775.8438682556152, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86029) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG oslo_db.sqlalchemy.engines [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86029) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writer thread running {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG cinder.db.api [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Building query based on filter {{(pid=86029) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86029) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:16:28 devstack cinder-volume[86029]: INFO cinder.keymgr.migration [None req-a29e6f5a-6804-4774-a6a5-771d8677a85e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 07:16:28 devstack sudo[86051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:16:28 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:16:28 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.236s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:16:28 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Driver initialization completed successfully. Sep 17 07:16:28 devstack cinder-volume[86029]: INFO cinder.manager [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Initiating service 3 cleanup Sep 17 07:16:28 devstack cinder-volume[86029]: INFO cinder.manager [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Service 3 cleanup completed. Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG cinder.service [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Creating RPC server for service cinder-volume {{(pid=86029) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG cinder.service [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86029) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 07:16:28 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:16:28 devstack sudo[86056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:16:28 devstack sudo[86056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:16:28 devstack sudo[86056]: pam_unix(sudo:session): session closed for user root Sep 17 07:16:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.252s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:16:28 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8ffd87ef-5c30-4bf9-a402-5b448992c91a None None] Driver post RPC initialization completed successfully. Sep 17 07:16:37 devstack cinder-volume[85731]: DEBUG dbcounter [-] [85731] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:16:38 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:16:38 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=2 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:17:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:17:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 6 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:17:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Flow 'volume_create_manager' (3645d272-ddc7-4c0a-85dc-4886eb46cb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3049829-3bb8-482e-a210-3166c0db4f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3049829-3bb8-482e-a210-3166c0db4f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-886669838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061de793-74ba-457f-9a8a-a177ec7c2ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9924653064455185a0e1bf4019808b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:17:25Z,use_quota=True,user_id='c7e2aa9dee3d453c9e456f9fda1efafe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9cd321-cde7-4c51-af01-f8397224f744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9cd321-cde7-4c51-af01-f8397224f744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f1cffe-21a2-46c4-9c52-e52453c076d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f1cffe-21a2-46c4-9c52-e52453c076d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061de793-74ba-457f-9a8a-a177ec7c2ce2', 'volume_name': 'volume-061de793-74ba-457f-9a8a-a177ec7c2ce2', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba1b3a7-7955-4d2c-a1e3-d54d071a891a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba1b3a7-7955-4d2c-a1e3-d54d071a891a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75276b9-ab75-4181-af91-c9f9f3887602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:17:25 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Volume 061de793-74ba-457f-9a8a-a177ec7c2ce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061de793-74ba-457f-9a8a-a177ec7c2ce2', 'volume_size': 1} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-886669838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061de793-74ba-457f-9a8a-a177ec7c2ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9924653064455185a0e1bf4019808b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:17:25Z,use_quota=True,user_id='c7e2aa9dee3d453c9e456f9fda1efafe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Creating volume 061de793-74ba-457f-9a8a-a177ec7c2ce2 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:17:25 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:17:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-061de793-74ba-457f-9a8a-a177ec7c2ce2 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:17:25 devstack sudo[86409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-061de793-74ba-457f-9a8a-a177ec7c2ce2 1073741824 Sep 17 07:17:25 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:17:26 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root Sep 17 07:17:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-061de793-74ba-457f-9a8a-a177ec7c2ce2 1073741824" returned: 0 in 0.760s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:17:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-061de793-74ba-457f-9a8a-a177ec7c2ce2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:17:26 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-061de793-74ba-457f-9a8a-a177ec7c2ce2 Sep 17 07:17:26 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:17:26 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Sep 17 07:17:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-061de793-74ba-457f-9a8a-a177ec7c2ce2" returned: 0 in 0.297s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:17:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:17:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:17:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75276b9-ab75-4181-af91-c9f9f3887602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061de793-74ba-457f-9a8a-a177ec7c2ce2', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:17:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0fec5f-849d-4006-acb4-1faed66c9ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:17:26 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Volume volume-061de793-74ba-457f-9a8a-a177ec7c2ce2 (061de793-74ba-457f-9a8a-a177ec7c2ce2): created successfully Sep 17 07:17:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0fec5f-849d-4006-acb4-1faed66c9ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:17:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Flow 'volume_create_manager' (3645d272-ddc7-4c0a-85dc-4886eb46cb28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:17:26 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-5f9e9976-5f11-4d7f-a3dc-9f6e18df9cb1 tempest-TaggedAttachmentsTest-1995448016 None] Created volume successfully. Sep 17 07:17:36 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:17:36 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:17:55 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:17:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Flow 'volume_create_manager' (34a7f237-ef93-4736-bf7c-d1ec14976578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:17:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8914fbf6-e8af-4eea-b90d-7993355a567d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:17:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8914fbf6-e8af-4eea-b90d-7993355a567d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-614569537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb66281-c0f8-4b11-b084-fd5b719d4187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25a5565e33e44229e0e94cbc2243e3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:17:56Z,use_quota=True,user_id='82669553a9774105b30ec0b5133253ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:17:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c932959-9859-4b64-aa6c-d7e32966e70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:17:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c932959-9859-4b64-aa6c-d7e32966e70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:17:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb08d652-a6d2-44fb-8dab-fabc19e60324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb08d652-a6d2-44fb-8dab-fabc19e60324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb66281-c0f8-4b11-b084-fd5b719d4187', 'volume_name': 'volume-3eb66281-c0f8-4b11-b084-fd5b719d4187', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546ca986-3b09-4644-bb47-41281161e179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546ca986-3b09-4644-bb47-41281161e179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c69260f4-fc4e-4e80-a8fc-141d4e5b08cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:17:56 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Volume 3eb66281-c0f8-4b11-b084-fd5b719d4187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb66281-c0f8-4b11-b084-fd5b719d4187', 'volume_size': 1} Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-614569537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb66281-c0f8-4b11-b084-fd5b719d4187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25a5565e33e44229e0e94cbc2243e3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:17:56Z,use_quota=True,user_id='82669553a9774105b30ec0b5133253ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Creating volume 3eb66281-c0f8-4b11-b084-fd5b719d4187 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:17:56 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:17:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3eb66281-c0f8-4b11-b084-fd5b719d4187 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:17:56 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3eb66281-c0f8-4b11-b084-fd5b719d4187 1073741824 Sep 17 07:17:56 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:17:57 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Sep 17 07:17:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3eb66281-c0f8-4b11-b084-fd5b719d4187 1073741824" returned: 0 in 1.172s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:17:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3eb66281-c0f8-4b11-b084-fd5b719d4187 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:17:57 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3eb66281-c0f8-4b11-b084-fd5b719d4187 Sep 17 07:17:57 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:17:58 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Sep 17 07:17:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3eb66281-c0f8-4b11-b084-fd5b719d4187" returned: 0 in 0.740s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:17:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:17:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.035s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:17:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c69260f4-fc4e-4e80-a8fc-141d4e5b08cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb66281-c0f8-4b11-b084-fd5b719d4187', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:17:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104cab1d-b3eb-43a3-aefc-d3a333468707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:17:58 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Volume volume-3eb66281-c0f8-4b11-b084-fd5b719d4187 (3eb66281-c0f8-4b11-b084-fd5b719d4187): created successfully Sep 17 07:17:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104cab1d-b3eb-43a3-aefc-d3a333468707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:17:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Flow 'volume_create_manager' (34a7f237-ef93-4736-bf7c-d1ec14976578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:17:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0c16e771-77d9-4f5a-84ee-c20cb15d9843 tempest-VolumesAdminNegativeTest-1286895925 None] Created volume successfully. Sep 17 07:17:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Acquiring lock "cinder-3eb66281-c0f8-4b11-b084-fd5b719d4187-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:17:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Lock "cinder-3eb66281-c0f8-4b11-b084-fd5b719d4187-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:18:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Acquiring lock "cinder-quobyte-3eb66281-c0f8-4b11-b084-fd5b719d4187" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:18:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Lock "cinder-quobyte-3eb66281-c0f8-4b11-b084-fd5b719d4187" acquired by "delete_volume" :: waited 0.054s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:18:00 devstack cinder-volume[86029]: INFO oslo.privsep.daemon [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp74fvkky4/privsep.sock'] Sep 17 07:18:00 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp74fvkky4/privsep.sock Sep 17 07:18:00 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:02 devstack cinder-volume[86029]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 17 07:18:02 devstack cinder-volume[86029]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 07:18:02 devstack cinder-volume[86029]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 17 07:18:02 devstack cinder-volume[86029]: WARNING oslo.privsep.daemon [-] privsep log: Sep 17 07:18:02 devstack cinder-volume[86029]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 17 07:18:02 devstack cinder-volume[86029]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 17 07:18:02 devstack cinder-volume[86029]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 07:18:02 devstack cinder-volume[86029]: WARNING oslo.privsep.daemon [-] privsep log: Sep 17 07:18:02 devstack cinder-volume[86029]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 17 07:18:02 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:02 devstack cinder-volume[86029]: INFO oslo.privsep.daemon [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Spawned new privsep daemon via rootwrap Sep 17 07:18:02 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Accepted privsep connection to /tmp/tmp74fvkky4/privsep.sock {{(pid=86029) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 17 07:18:02 devstack cinder-volume[86029]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 17 07:18:02 devstack cinder-volume[86029]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 17 07:18:02 devstack cinder-volume[86029]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 17 07:18:02 devstack cinder-volume[86029]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87223 Sep 17 07:18:02 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d5f129-190b-49e4-b391-3d72ddcfb6a8]: (2,) {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:18:02 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[854acfa8-27cf-4e6d-a2b6-b5ac2eb8d925]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:18:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3eb66281-c0f8-4b11-b084-fd5b719d4187 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:02 devstack sudo[87225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3eb66281-c0f8-4b11-b084-fd5b719d4187 Sep 17 07:18:02 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:03 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3eb66281-c0f8-4b11-b084-fd5b719d4187" returned: 0 in 0.797s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3eb66281-c0f8-4b11-b084-fd5b719d4187 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:03 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3eb66281-c0f8-4b11-b084-fd5b719d4187 Sep 17 07:18:03 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:04 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3eb66281-c0f8-4b11-b084-fd5b719d4187" returned: 0 in 0.960s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Lock "cinder-quobyte-3eb66281-c0f8-4b11-b084-fd5b719d4187" released by "delete_volume" :: held 4.232s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:18:04 devstack cinder-volume[86029]: WARNING cinder.quota [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:18:04 devstack cinder-volume[86029]: WARNING cinder.quota [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:18:04 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Created reservations ['ed722c89-9cfb-403d-8119-bcf60c352dd8', '28e8affc-2a12-4a9e-84f9-ece339246543', 'd84de66e-07b9-48f0-ae1c-42761c2320bd', '4459d414-87b0-408e-98b8-5e1029e57f9b'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:18:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:18:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:18:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:18:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:18:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:18:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:18:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:04 devstack sudo[87275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:18:04 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:18:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:18:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:18:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:18:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:18:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:05 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:18:05 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:05 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.810s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:06 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:18:06 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Deleted volume successfully. Sep 17 07:18:06 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 1.247s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:06 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:18:06 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:18:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 8 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:18:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:18:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1245bc05-e005-4237-a705-edcc237f4c91 tempest-VolumesAdminNegativeTest-1286895925 None] Lock "cinder-3eb66281-c0f8-4b11-b084-fd5b719d4187-delete_volume" released by "delete_volume" :: held 6.219s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Flow 'volume_create_manager' (fb58d718-330e-45c3-8499-d9e8a241ab35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b71a7e4-8c2f-4afe-ae4d-62310e9d6920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b71a7e4-8c2f-4afe-ae4d-62310e9d6920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2006234205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479a0079-88e6-4698-a444-40442475f989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09b9e3b67e7e4d2db7c183868d9186f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:18:16Z,use_quota=True,user_id='4c08c4b3353d4822838646d01f9ebfe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5b8a80-d36d-43aa-a357-b058569ebd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5b8a80-d36d-43aa-a357-b058569ebd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f2d71c-323d-4d5f-9dd9-02f21ab85637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f2d71c-323d-4d5f-9dd9-02f21ab85637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '479a0079-88e6-4698-a444-40442475f989', 'volume_name': 'volume-479a0079-88e6-4698-a444-40442475f989', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a86692f-e044-4ef9-a6c7-a9616705a860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a86692f-e044-4ef9-a6c7-a9616705a860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db35d442-abc2-4549-afa7-eb9204e06c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:15 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Volume 479a0079-88e6-4698-a444-40442475f989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-479a0079-88e6-4698-a444-40442475f989', 'volume_size': 1} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2006234205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479a0079-88e6-4698-a444-40442475f989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09b9e3b67e7e4d2db7c183868d9186f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:18:16Z,use_quota=True,user_id='4c08c4b3353d4822838646d01f9ebfe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Creating volume 479a0079-88e6-4698-a444-40442475f989 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:18:15 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:18:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-479a0079-88e6-4698-a444-40442475f989 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:15 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-479a0079-88e6-4698-a444-40442475f989 1073741824 Sep 17 07:18:15 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:16 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-479a0079-88e6-4698-a444-40442475f989 1073741824" returned: 0 in 0.556s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-479a0079-88e6-4698-a444-40442475f989 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:16 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-479a0079-88e6-4698-a444-40442475f989 Sep 17 07:18:16 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:16 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-479a0079-88e6-4698-a444-40442475f989" returned: 0 in 0.278s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:18:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:18:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db35d442-abc2-4549-afa7-eb9204e06c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-479a0079-88e6-4698-a444-40442475f989', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43de6cfd-fa9f-4459-85f3-c1dbed965024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:16 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Volume volume-479a0079-88e6-4698-a444-40442475f989 (479a0079-88e6-4698-a444-40442475f989): created successfully Sep 17 07:18:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43de6cfd-fa9f-4459-85f3-c1dbed965024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Flow 'volume_create_manager' (fb58d718-330e-45c3-8499-d9e8a241ab35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:18:16 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-43e1ddba-96df-43f9-a012-152a7b063ed5 tempest-ServersNegativeTestJSON-441755018 None] Created volume successfully. Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Flow 'volume_create_manager' (71cd14cd-ab25-43ff-9197-204a84496cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de504dd-a2d5-4ec0-a8b7-dec7b07cd680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de504dd-a2d5-4ec0-a8b7-dec7b07cd680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-91924223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f714f45e-898b-4ec4-9c2b-070452043c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09b9e3b67e7e4d2db7c183868d9186f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:18:24Z,use_quota=True,user_id='4c08c4b3353d4822838646d01f9ebfe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415165d0-0afa-403d-80ee-2645084ddadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415165d0-0afa-403d-80ee-2645084ddadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec476991-9def-479f-b326-da6bec329ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec476991-9def-479f-b326-da6bec329ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f714f45e-898b-4ec4-9c2b-070452043c4f', 'volume_name': 'volume-f714f45e-898b-4ec4-9c2b-070452043c4f', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca641348-288a-435a-bcab-e0c42ab19442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca641348-288a-435a-bcab-e0c42ab19442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627dac63-b76e-4535-8250-98c11f5136a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:24 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Volume f714f45e-898b-4ec4-9c2b-070452043c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f714f45e-898b-4ec4-9c2b-070452043c4f', 'volume_size': 1} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-91924223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f714f45e-898b-4ec4-9c2b-070452043c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09b9e3b67e7e4d2db7c183868d9186f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:18:24Z,use_quota=True,user_id='4c08c4b3353d4822838646d01f9ebfe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Creating volume f714f45e-898b-4ec4-9c2b-070452043c4f {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:18:24 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f714f45e-898b-4ec4-9c2b-070452043c4f 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:24 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f714f45e-898b-4ec4-9c2b-070452043c4f 1073741824 Sep 17 07:18:24 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:24 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f714f45e-898b-4ec4-9c2b-070452043c4f 1073741824" returned: 0 in 0.622s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f714f45e-898b-4ec4-9c2b-070452043c4f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:24 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f714f45e-898b-4ec4-9c2b-070452043c4f Sep 17 07:18:24 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:25 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f714f45e-898b-4ec4-9c2b-070452043c4f" returned: 0 in 0.302s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:18:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:18:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627dac63-b76e-4535-8250-98c11f5136a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f714f45e-898b-4ec4-9c2b-070452043c4f', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ae7f61-083d-4f3f-81d1-494f2f7db836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:25 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Volume volume-f714f45e-898b-4ec4-9c2b-070452043c4f (f714f45e-898b-4ec4-9c2b-070452043c4f): created successfully Sep 17 07:18:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ae7f61-083d-4f3f-81d1-494f2f7db836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Flow 'volume_create_manager' (71cd14cd-ab25-43ff-9197-204a84496cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:18:25 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-23cbe61c-1357-4c68-9156-f0d47b190c07 tempest-ServersNegativeTestJSON-441755018 None] Created volume successfully. Sep 17 07:18:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Acquiring lock "cinder-f714f45e-898b-4ec4-9c2b-070452043c4f-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:18:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Lock "cinder-f714f45e-898b-4ec4-9c2b-070452043c4f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:18:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Acquiring lock "cinder-quobyte-f714f45e-898b-4ec4-9c2b-070452043c4f" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:18:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Lock "cinder-quobyte-f714f45e-898b-4ec4-9c2b-070452043c4f" acquired by "delete_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:18:26 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d85b78-3f0a-4bdb-a304-781bd59d1313]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:18:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f714f45e-898b-4ec4-9c2b-070452043c4f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:27 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f714f45e-898b-4ec4-9c2b-070452043c4f Sep 17 07:18:27 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:27 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f714f45e-898b-4ec4-9c2b-070452043c4f" returned: 0 in 0.533s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f714f45e-898b-4ec4-9c2b-070452043c4f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:27 devstack sudo[87418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f714f45e-898b-4ec4-9c2b-070452043c4f Sep 17 07:18:27 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:27 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f714f45e-898b-4ec4-9c2b-070452043c4f" returned: 0 in 0.319s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Lock "cinder-quobyte-f714f45e-898b-4ec4-9c2b-070452043c4f" released by "delete_volume" :: held 0.912s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:18:27 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Created reservations ['8635d5d9-8608-4c04-8bc2-9e63bd57bb00', 'b44ea5f7-fa5b-42d2-8f4a-9e382f4754b2', '1b5e8338-3b6f-4fc9-8d05-52e96d85be9b', '897377ce-6936-40a0-acbc-351d78c3f143'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:18:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:18:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:18:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:18:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:18:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:18:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:27 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:18:27 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Acquiring lock "cinder-479a0079-88e6-4698-a444-40442475f989-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:18:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Lock "cinder-479a0079-88e6-4698-a444-40442475f989-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:18:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Acquiring lock "cinder-quobyte-479a0079-88e6-4698-a444-40442475f989" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:18:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Lock "cinder-quobyte-479a0079-88e6-4698-a444-40442475f989" acquired by "delete_volume" :: waited 0.052s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:18:28 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bd8911-4632-40f7-ba62-a6e7f4cee4f7]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:18:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-479a0079-88e6-4698-a444-40442475f989 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:28 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.423s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:28 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:18:28 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Deleted volume successfully. Sep 17 07:18:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7fac8622-7a94-437d-89b5-20ab8aaa1760 tempest-ServersNegativeTestJSON-441755018 None] Lock "cinder-f714f45e-898b-4ec4-9c2b-070452043c4f-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:18:28 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-479a0079-88e6-4698-a444-40442475f989 Sep 17 07:18:28 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:28 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-479a0079-88e6-4698-a444-40442475f989" returned: 0 in 0.564s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-479a0079-88e6-4698-a444-40442475f989 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:28 devstack sudo[87433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-479a0079-88e6-4698-a444-40442475f989 Sep 17 07:18:28 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:29 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-479a0079-88e6-4698-a444-40442475f989" returned: 0 in 0.349s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Lock "cinder-quobyte-479a0079-88e6-4698-a444-40442475f989" released by "delete_volume" :: held 0.995s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:18:29 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Created reservations ['7734f353-66a9-4adc-82bd-936341b6fd4b', 'ed9a5384-ea83-45cb-bd6e-4ce2b0a0edef', '50ca54c1-7506-4c2f-83b0-76ac5d823743', '026606bb-9192-45de-8b57-b6aa2e604124'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:18:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:18:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:18:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:18:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:18:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:18:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:29 devstack sudo[87438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:18:29 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:29 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.325s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:29 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:18:29 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Deleted volume successfully. Sep 17 07:18:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ebf6fbf8-dc6e-4a3b-8aa2-84dcb6774ab6 tempest-ServersNegativeTestJSON-441755018 None] Lock "cinder-479a0079-88e6-4698-a444-40442475f989-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:18:39 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=22,cinder:UPDATE=33,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:18:39 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=15,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:18:40 devstack cinder-volume[86029]: WARNING py.warnings [req-ef7d2059-76e7-4cca-b6b6-6d11322bc338 req-d15dbd6b-cefd-402d-9b11-d2c70e6146b7 tempest-TaggedAttachmentsTest-1995448016 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 17 07:18:40 devstack cinder-volume[86029]: .first() Sep 17 07:18:40 devstack cinder-volume[86029]: Sep 17 07:18:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-ef7d2059-76e7-4cca-b6b6-6d11322bc338 req-d15dbd6b-cefd-402d-9b11-d2c70e6146b7 tempest-TaggedAttachmentsTest-1995448016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:18:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-ef7d2059-76e7-4cca-b6b6-6d11322bc338 req-d15dbd6b-cefd-402d-9b11-d2c70e6146b7 tempest-TaggedAttachmentsTest-1995448016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:18:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-ef7d2059-76e7-4cca-b6b6-6d11322bc338 req-d15dbd6b-cefd-402d-9b11-d2c70e6146b7 tempest-TaggedAttachmentsTest-1995448016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:18:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-ef7d2059-76e7-4cca-b6b6-6d11322bc338 req-d15dbd6b-cefd-402d-9b11-d2c70e6146b7 tempest-TaggedAttachmentsTest-1995448016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-061de793-74ba-457f-9a8a-a177ec7c2ce2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '677000c3-9d2b-4500-a6d4-574b4d846269', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:18:40 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-ef7d2059-76e7-4cca-b6b6-6d11322bc338 req-d15dbd6b-cefd-402d-9b11-d2c70e6146b7 tempest-TaggedAttachmentsTest-1995448016 None] attachment_update completed successfully. Sep 17 07:18:46 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-2cbfc67b-33e6-4b8a-993f-2f4ed51f7858 req-4a09f5f3-6928-4842-a5cf-385f8ebcc895 tempest-TaggedAttachmentsTest-1995448016 None] Terminate volume connection completed successfully. Sep 17 07:18:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-2cbfc67b-33e6-4b8a-993f-2f4ed51f7858 req-4a09f5f3-6928-4842-a5cf-385f8ebcc895 tempest-TaggedAttachmentsTest-1995448016 None] Deleting attachment 677000c3-9d2b-4500-a6d4-574b4d846269. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:18:50 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Flow 'volume_create_manager' (d3f11f1c-65fa-43b0-b064-7ff1ad920107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e2e4e2-3429-4f7d-94f1-8f09d0500b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e2e4e2-3429-4f7d-94f1-8f09d0500b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-340949184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e180f9-5979-41ef-977d-d2d015b75fc7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ebd0a925b5a04bab844b4fb089e81a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:18:54Z,use_quota=True,user_id='207aa5678f0743dcb5cf0dc837c78dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d47595-a2f2-4956-ad81-e1fc7aeefc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d47595-a2f2-4956-ad81-e1fc7aeefc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ee6397-84f8-444b-b407-4471dfb8a371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ee6397-84f8-444b-b407-4471dfb8a371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e180f9-5979-41ef-977d-d2d015b75fc7', 'volume_name': 'volume-13e180f9-5979-41ef-977d-d2d015b75fc7', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c073356-4794-40e0-8e25-0e0ffae1ab3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c073356-4794-40e0-8e25-0e0ffae1ab3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6264b8ea-6144-4923-a1b7-c2d3d5846e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:53 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Volume 13e180f9-5979-41ef-977d-d2d015b75fc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e180f9-5979-41ef-977d-d2d015b75fc7', 'volume_size': 1} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-340949184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e180f9-5979-41ef-977d-d2d015b75fc7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ebd0a925b5a04bab844b4fb089e81a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:18:54Z,use_quota=True,user_id='207aa5678f0743dcb5cf0dc837c78dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Creating volume 13e180f9-5979-41ef-977d-d2d015b75fc7 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:18:53 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:18:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-13e180f9-5979-41ef-977d-d2d015b75fc7 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:53 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-13e180f9-5979-41ef-977d-d2d015b75fc7 1073741824 Sep 17 07:18:53 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:54 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-13e180f9-5979-41ef-977d-d2d015b75fc7 1073741824" returned: 0 in 0.650s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-13e180f9-5979-41ef-977d-d2d015b75fc7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:54 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-13e180f9-5979-41ef-977d-d2d015b75fc7 Sep 17 07:18:54 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:54 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-13e180f9-5979-41ef-977d-d2d015b75fc7" returned: 0 in 0.361s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:18:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:18:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6264b8ea-6144-4923-a1b7-c2d3d5846e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e180f9-5979-41ef-977d-d2d015b75fc7', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afad0c6b-143a-4ed8-86fb-5283c3ef1b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:54 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Volume volume-13e180f9-5979-41ef-977d-d2d015b75fc7 (13e180f9-5979-41ef-977d-d2d015b75fc7): created successfully Sep 17 07:18:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afad0c6b-143a-4ed8-86fb-5283c3ef1b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Flow 'volume_create_manager' (d3f11f1c-65fa-43b0-b064-7ff1ad920107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:18:54 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-39ee0eaf-e8b7-4f82-9bed-654fa3ce1762 tempest-VolumesTestJSON-397794819 None] Created volume successfully. Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Flow 'volume_create_manager' (9936a083-7b5c-4b8b-ad7a-9b38071d9f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65dbf9bc-5a23-46a5-8c64-a72a37551bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65dbf9bc-5a23-46a5-8c64-a72a37551bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1416404440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22069fca-c235-4fbf-a7c3-df43f92bb5dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ebd0a925b5a04bab844b4fb089e81a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:18:56Z,use_quota=True,user_id='207aa5678f0743dcb5cf0dc837c78dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3272a5e7-f0d9-4705-a4dd-027b1fdae995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3272a5e7-f0d9-4705-a4dd-027b1fdae995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7abf08-2fa9-425b-a93b-4226db6c5e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7abf08-2fa9-425b-a93b-4226db6c5e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22069fca-c235-4fbf-a7c3-df43f92bb5dd', 'volume_name': 'volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb64ef0-818b-4ea2-a64c-79d1ca8ae977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb64ef0-818b-4ea2-a64c-79d1ca8ae977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a19225a-b878-4b84-be10-4ab442c368db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:56 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Volume 22069fca-c235-4fbf-a7c3-df43f92bb5dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd', 'volume_size': 1} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1416404440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22069fca-c235-4fbf-a7c3-df43f92bb5dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ebd0a925b5a04bab844b4fb089e81a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:18:56Z,use_quota=True,user_id='207aa5678f0743dcb5cf0dc837c78dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Creating volume 22069fca-c235-4fbf-a7c3-df43f92bb5dd {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:18:56 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:56 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd 1073741824 Sep 17 07:18:56 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:56 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd 1073741824" returned: 0 in 0.531s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:18:57 devstack sudo[88245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd Sep 17 07:18:57 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:57 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd" returned: 0 in 0.541s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:18:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:18:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:18:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a19225a-b878-4b84-be10-4ab442c368db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3f6fe3-aab4-4750-a85d-6deb21610120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:18:57 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Volume volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd (22069fca-c235-4fbf-a7c3-df43f92bb5dd): created successfully Sep 17 07:18:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3f6fe3-aab4-4750-a85d-6deb21610120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:18:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Flow 'volume_create_manager' (9936a083-7b5c-4b8b-ad7a-9b38071d9f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:18:57 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-de40b04c-5282-4263-ae74-e7abd901704e tempest-VolumesTestJSON-397794819 None] Created volume successfully. Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Acquiring lock "cinder-061de793-74ba-457f-9a8a-a177ec7c2ce2-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Lock "cinder-061de793-74ba-457f-9a8a-a177ec7c2ce2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Acquiring lock "cinder-quobyte-061de793-74ba-457f-9a8a-a177ec7c2ce2" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Flow 'volume_create_manager' (85a0f18b-c2e4-4c5b-8066-e5201dedb986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d64261-e074-4c69-a9a9-d49af4617a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Lock "cinder-quobyte-061de793-74ba-457f-9a8a-a177ec7c2ce2" acquired by "delete_volume" :: waited 0.058s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d64261-e074-4c69-a9a9-d49af4617a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-575977664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a13b3e-b8b5-4896-9951-c4c3782c2797,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ebd0a925b5a04bab844b4fb089e81a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:19:00Z,use_quota=True,user_id='207aa5678f0743dcb5cf0dc837c78dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab08a7ea-bda8-4e23-8ea7-34c58ee2fbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab08a7ea-bda8-4e23-8ea7-34c58ee2fbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fde56f-6480-4993-8a9d-fecdf145d1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fde56f-6480-4993-8a9d-fecdf145d1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a13b3e-b8b5-4896-9951-c4c3782c2797', 'volume_name': 'volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c95d3f-6d18-44cb-91f4-3b788f2955cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c95d3f-6d18-44cb-91f4-3b788f2955cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca34aaf-28a4-4cc3-a1ee-53db560d4edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:00 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Volume b7a13b3e-b8b5-4896-9951-c4c3782c2797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797', 'volume_size': 1} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-575977664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a13b3e-b8b5-4896-9951-c4c3782c2797,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ebd0a925b5a04bab844b4fb089e81a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:19:00Z,use_quota=True,user_id='207aa5678f0743dcb5cf0dc837c78dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Creating volume b7a13b3e-b8b5-4896-9951-c4c3782c2797 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:19:00 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ad93cd-b94f-471d-918c-39b7f52dfd2f]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-061de793-74ba-457f-9a8a-a177ec7c2ce2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:00 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797 1073741824 Sep 17 07:19:00 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:00 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-061de793-74ba-457f-9a8a-a177ec7c2ce2 Sep 17 07:19:00 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:00 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-061de793-74ba-457f-9a8a-a177ec7c2ce2" returned: 0 in 0.415s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-061de793-74ba-457f-9a8a-a177ec7c2ce2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:00 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-061de793-74ba-457f-9a8a-a177ec7c2ce2 Sep 17 07:19:00 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:00 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797 1073741824" returned: 0 in 0.506s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:00 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797 Sep 17 07:19:00 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:01 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-061de793-74ba-457f-9a8a-a177ec7c2ce2" returned: 0 in 0.290s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Lock "cinder-quobyte-061de793-74ba-457f-9a8a-a177ec7c2ce2" released by "delete_volume" :: held 0.823s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Created reservations ['e7f30e75-3fc0-4b3a-bdee-dbb2dab9c489', '70505e32-939d-4b63-b736-c5a769445918', 'c3142941-58c1-493b-8f33-c406ef402496', '7e158846-0e93-49e7-be6c-65b3e0141e91'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:01 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:19:01 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:01 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797" returned: 0 in 0.325s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca34aaf-28a4-4cc3-a1ee-53db560d4edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf27eb86-59c6-4f00-b0f2-643c80eb9676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:01 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Volume volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797 (b7a13b3e-b8b5-4896-9951-c4c3782c2797): created successfully Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf27eb86-59c6-4f00-b0f2-643c80eb9676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Flow 'volume_create_manager' (85a0f18b-c2e4-4c5b-8066-e5201dedb986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:19:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8921b46d-8d2a-49fe-9436-fbd7a72bb0ee tempest-VolumesTestJSON-397794819 None] Created volume successfully. Sep 17 07:19:01 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.342s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:19:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Deleted volume successfully. Sep 17 07:19:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ff7eb240-7d40-415b-87ae-f9cb9c77447f tempest-TaggedAttachmentsTest-1995448016 None] Lock "cinder-061de793-74ba-457f-9a8a-a177ec7c2ce2-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Flow 'volume_create_manager' (805d6068-7af6-47b3-98a0-7bd3b1b3223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6728ba-2385-4cf1-82f0-3eb794e566e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6728ba-2385-4cf1-82f0-3eb794e566e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1653771516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c8752f-85de-42f5-b9db-03230ddc9e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d975ce934c6e4374839ab822029d50a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:19:03Z,use_quota=True,user_id='b56f220c94944c4e98756555c8e95b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29203a1c-1267-4738-abb1-4a5ece40fcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29203a1c-1267-4738-abb1-4a5ece40fcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10818ec-1dbd-4753-b0db-06a09730148e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10818ec-1dbd-4753-b0db-06a09730148e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c8752f-85de-42f5-b9db-03230ddc9e50', 'volume_name': 'volume-47c8752f-85de-42f5-b9db-03230ddc9e50', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6644fd32-f36e-49b8-8858-8df82153fb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6644fd32-f36e-49b8-8858-8df82153fb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d927b5-277e-4475-8a37-6aa9cfc6cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:02 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Volume 47c8752f-85de-42f5-b9db-03230ddc9e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c8752f-85de-42f5-b9db-03230ddc9e50', 'volume_size': 1} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1653771516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c8752f-85de-42f5-b9db-03230ddc9e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d975ce934c6e4374839ab822029d50a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:19:03Z,use_quota=True,user_id='b56f220c94944c4e98756555c8e95b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Creating volume 47c8752f-85de-42f5-b9db-03230ddc9e50 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:19:02 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:19:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47c8752f-85de-42f5-b9db-03230ddc9e50 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:02 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47c8752f-85de-42f5-b9db-03230ddc9e50 1073741824 Sep 17 07:19:02 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:03 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47c8752f-85de-42f5-b9db-03230ddc9e50 1073741824" returned: 0 in 0.628s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47c8752f-85de-42f5-b9db-03230ddc9e50 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:03 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47c8752f-85de-42f5-b9db-03230ddc9e50 Sep 17 07:19:03 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:03 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47c8752f-85de-42f5-b9db-03230ddc9e50" returned: 0 in 0.296s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Acquiring lock "cinder-b7a13b3e-b8b5-4896-9951-c4c3782c2797-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d927b5-277e-4475-8a37-6aa9cfc6cb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c8752f-85de-42f5-b9db-03230ddc9e50', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7245c428-a6fe-46d9-adbb-465b2aed1772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Lock "cinder-b7a13b3e-b8b5-4896-9951-c4c3782c2797-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:19:03 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Volume volume-47c8752f-85de-42f5-b9db-03230ddc9e50 (47c8752f-85de-42f5-b9db-03230ddc9e50): created successfully Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7245c428-a6fe-46d9-adbb-465b2aed1772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Flow 'volume_create_manager' (805d6068-7af6-47b3-98a0-7bd3b1b3223a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Acquiring lock "cinder-quobyte-b7a13b3e-b8b5-4896-9951-c4c3782c2797" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:19:03 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-fddf091c-2247-4554-89da-fee388fc65e7 tempest-DeleteServersTestJSON-100170477 None] Created volume successfully. Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Lock "cinder-quobyte-b7a13b3e-b8b5-4896-9951-c4c3782c2797" acquired by "delete_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fb536d-d0df-4500-a333-c715fe23c010]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:19:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:03 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797 Sep 17 07:19:03 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:04 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797" returned: 0 in 0.420s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:04 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797 Sep 17 07:19:04 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:04 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b7a13b3e-b8b5-4896-9951-c4c3782c2797" returned: 0 in 0.353s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Lock "cinder-quobyte-b7a13b3e-b8b5-4896-9951-c4c3782c2797" released by "delete_volume" :: held 0.829s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Created reservations ['3c8c8b45-f938-4cbf-82a5-bb5af15e5b7a', '8295103f-4052-43a3-9177-cb06158adec0', '8e873640-7509-463e-b02c-d25abc4a940c', 'fd51b5dd-31bd-453f-a59b-010a5d83b51f'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:04 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:19:04 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:05 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:19:05 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Acquiring lock "cinder-22069fca-c235-4fbf-a7c3-df43f92bb5dd-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Lock "cinder-22069fca-c235-4fbf-a7c3-df43f92bb5dd-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:19:05 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.486s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 8 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Acquiring lock "cinder-quobyte-22069fca-c235-4fbf-a7c3-df43f92bb5dd" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Lock "cinder-quobyte-22069fca-c235-4fbf-a7c3-df43f92bb5dd" acquired by "delete_volume" :: waited 0.051s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8341d356-af10-4be0-904e-ff94fe160e38]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:05 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd Sep 17 07:19:05 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Flow 'volume_create_manager' (20aec268-714f-41bd-94e1-1185250c3889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e968b690-beb2-4be3-a0b7-6e3cc27cf490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:05 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.898s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:19:05 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Deleted volume successfully. Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e968b690-beb2-4be3-a0b7-6e3cc27cf490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2018085302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25eef40-5c34-4919-a7f4-bc919a61b22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61b7b4747564e66a5b0be87a56b5c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:19:06Z,use_quota=True,user_id='94fcc053fbef4a7aa16698af3b4416b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5092c26-23b7-4145-afad-ad2f1e11a7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5092c26-23b7-4145-afad-ad2f1e11a7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7dd2fa9-b7e3-47de-993e-372d8bfe09db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7dd2fa9-b7e3-47de-993e-372d8bfe09db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd25eef40-5c34-4919-a7f4-bc919a61b22a', 'volume_name': 'volume-d25eef40-5c34-4919-a7f4-bc919a61b22a', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8108895e-776c-4372-9239-cbf03307b383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8108895e-776c-4372-9239-cbf03307b383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703f6c99-12f4-4f71-b093-2a43e89629cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:06 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Volume d25eef40-5c34-4919-a7f4-bc919a61b22a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d25eef40-5c34-4919-a7f4-bc919a61b22a', 'volume_size': 1} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2018085302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25eef40-5c34-4919-a7f4-bc919a61b22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61b7b4747564e66a5b0be87a56b5c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:19:06Z,use_quota=True,user_id='94fcc053fbef4a7aa16698af3b4416b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Creating volume d25eef40-5c34-4919-a7f4-bc919a61b22a {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:19:06 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d25eef40-5c34-4919-a7f4-bc919a61b22a 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:06 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d25eef40-5c34-4919-a7f4-bc919a61b22a 1073741824 Sep 17 07:19:06 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-34c781eb-3661-4a34-96dc-c6ae576b9c9c tempest-VolumesTestJSON-397794819 None] Lock "cinder-b7a13b3e-b8b5-4896-9951-c4c3782c2797-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:19:06 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd" returned: 0 in 0.817s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:06 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd Sep 17 07:19:06 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-6f6b453e-ff52-479f-be2e-e1102fb91d4e req-4da8ea9a-7d9b-41d9-a688-7ecd7ef54a77 tempest-DeleteServersTestJSON-100170477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:06 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d25eef40-5c34-4919-a7f4-bc919a61b22a 1073741824" returned: 0 in 0.716s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:06 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-22069fca-c235-4fbf-a7c3-df43f92bb5dd" returned: 0 in 0.549s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Lock "cinder-quobyte-22069fca-c235-4fbf-a7c3-df43f92bb5dd" released by "delete_volume" :: held 1.465s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:19:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d25eef40-5c34-4919-a7f4-bc919a61b22a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:06 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d25eef40-5c34-4919-a7f4-bc919a61b22a Sep 17 07:19:06 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Created reservations ['a5000da1-a495-45c3-b87f-ca5cbada5b61', '21635482-ea0d-46cf-b35c-7dc6bd0b197c', '865c7f5a-9af2-450d-804b-f519a1d9afeb', '9d75967e-c5cf-4246-b24d-49098eeb543f'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:07 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:07 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:19:07 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d25eef40-5c34-4919-a7f4-bc919a61b22a" returned: 0 in 0.430s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-6f6b453e-ff52-479f-be2e-e1102fb91d4e req-4da8ea9a-7d9b-41d9-a688-7ecd7ef54a77 tempest-DeleteServersTestJSON-100170477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.762s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-6f6b453e-ff52-479f-be2e-e1102fb91d4e req-4da8ea9a-7d9b-41d9-a688-7ecd7ef54a77 tempest-DeleteServersTestJSON-100170477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703f6c99-12f4-4f71-b093-2a43e89629cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d25eef40-5c34-4919-a7f4-bc919a61b22a', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7dd65e-45b6-4fe9-a278-99138a1a9fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-6f6b453e-ff52-479f-be2e-e1102fb91d4e req-4da8ea9a-7d9b-41d9-a688-7ecd7ef54a77 tempest-DeleteServersTestJSON-100170477 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-47c8752f-85de-42f5-b9db-03230ddc9e50', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99f289ee-df31-4bc6-a64f-7383fc8021b0', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:19:07 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Volume volume-d25eef40-5c34-4919-a7f4-bc919a61b22a (d25eef40-5c34-4919-a7f4-bc919a61b22a): created successfully Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7dd65e-45b6-4fe9-a278-99138a1a9fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Flow 'volume_create_manager' (20aec268-714f-41bd-94e1-1185250c3889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:19:07 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0850ebc6-ccef-4430-9ef1-1278067205b8 tempest-ServerActionsTestOtherA-1088735529 None] Created volume successfully. Sep 17 07:19:07 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-6f6b453e-ff52-479f-be2e-e1102fb91d4e req-4da8ea9a-7d9b-41d9-a688-7ecd7ef54a77 tempest-DeleteServersTestJSON-100170477 None] attachment_update completed successfully. Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Acquiring lock "cinder-13e180f9-5979-41ef-977d-d2d015b75fc7-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Lock "cinder-13e180f9-5979-41ef-977d-d2d015b75fc7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Acquiring lock "cinder-quobyte-13e180f9-5979-41ef-977d-d2d015b75fc7" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Lock "cinder-quobyte-13e180f9-5979-41ef-977d-d2d015b75fc7" acquired by "delete_volume" :: waited 0.046s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[03867bed-9cdc-4c92-be23-19678e936a7d]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:19:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-13e180f9-5979-41ef-977d-d2d015b75fc7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:08 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.842s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:08 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:19:08 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Deleted volume successfully. Sep 17 07:19:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e092492c-cfeb-4de6-80dd-48d80bd02d48 tempest-VolumesTestJSON-397794819 None] Lock "cinder-22069fca-c235-4fbf-a7c3-df43f92bb5dd-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:19:08 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-13e180f9-5979-41ef-977d-d2d015b75fc7 Sep 17 07:19:08 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:08 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-13e180f9-5979-41ef-977d-d2d015b75fc7" returned: 0 in 0.639s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-13e180f9-5979-41ef-977d-d2d015b75fc7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:08 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-13e180f9-5979-41ef-977d-d2d015b75fc7 Sep 17 07:19:08 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:09 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-13e180f9-5979-41ef-977d-d2d015b75fc7" returned: 0 in 0.620s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:09 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Lock "cinder-quobyte-13e180f9-5979-41ef-977d-d2d015b75fc7" released by "delete_volume" :: held 1.347s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:19:09 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Created reservations ['6a6d5f96-e742-4ef7-bcdb-2566bcbf6764', '0f433224-d76d-423b-9903-52313189ebe0', '0dbdc03b-f6fb-4eda-9531-66364601bdf7', '328d3dab-5fa0-412e-9758-daa2ce72ddc5'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:19:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:19:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:19:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:09 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:19:09 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:10 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.565s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:10 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:19:10 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Deleted volume successfully. Sep 17 07:19:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2c632ee1-a028-443a-9301-c5a21b516168 tempest-VolumesTestJSON-397794819 None] Lock "cinder-13e180f9-5979-41ef-977d-d2d015b75fc7-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:19:12 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-90f97116-90e3-4aa9-a740-cdf13e1ad965 req-1f958648-a58a-4c80-a2c5-ab1521725c33 tempest-DeleteServersTestJSON-100170477 None] Terminate volume connection completed successfully. Sep 17 07:19:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-90f97116-90e3-4aa9-a740-cdf13e1ad965 req-1f958648-a58a-4c80-a2c5-ab1521725c33 tempest-DeleteServersTestJSON-100170477 None] Deleting attachment 99f289ee-df31-4bc6-a64f-7383fc8021b0. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:19:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Acquiring lock "cinder-47c8752f-85de-42f5-b9db-03230ddc9e50-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:19:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Lock "cinder-47c8752f-85de-42f5-b9db-03230ddc9e50-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:19:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Acquiring lock "cinder-quobyte-47c8752f-85de-42f5-b9db-03230ddc9e50" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:19:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Lock "cinder-quobyte-47c8752f-85de-42f5-b9db-03230ddc9e50" acquired by "delete_volume" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:19:13 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[87af1a43-5c3f-416d-805e-12232ed490f2]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:19:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47c8752f-85de-42f5-b9db-03230ddc9e50 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:13 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47c8752f-85de-42f5-b9db-03230ddc9e50 Sep 17 07:19:13 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:14 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47c8752f-85de-42f5-b9db-03230ddc9e50" returned: 0 in 0.479s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47c8752f-85de-42f5-b9db-03230ddc9e50 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:14 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47c8752f-85de-42f5-b9db-03230ddc9e50 Sep 17 07:19:14 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:14 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47c8752f-85de-42f5-b9db-03230ddc9e50" returned: 0 in 0.549s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Lock "cinder-quobyte-47c8752f-85de-42f5-b9db-03230ddc9e50" released by "delete_volume" :: held 1.102s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:19:14 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Created reservations ['3914283f-b12c-4727-8fe5-8b6c3df20b56', '961a7ca5-e961-44d5-9701-6d932dafb3c9', 'd81143dd-a64c-4faf-9418-527d4a77c38d', '5a2a6962-9fd7-4750-9d87-d7751a777cf7'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:19:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:19:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:19:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:15 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:19:15 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:15 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.382s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:15 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:19:15 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Deleted volume successfully. Sep 17 07:19:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8051727d-629a-43f4-b1b9-d35a441f194e tempest-DeleteServersTestJSON-100170477 None] Lock "cinder-47c8752f-85de-42f5-b9db-03230ddc9e50-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:19:24 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=49,cinder:UPDATE=61,cinder:INSERT=12,cinder:DELETE=5 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:19:25 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=43,cinder:UPDATE=54,cinder:INSERT=13,cinder:DELETE=5 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:19:27 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3fbee919-f89f-45a0-a4c4-bde672780017 tempest-GroupsV314Test-2089613031 None] Group tempest-GroupsV314Test-Group-1947011101: creating Sep 17 07:19:27 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3fbee919-f89f-45a0-a4c4-bde672780017 tempest-GroupsV314Test-2089613031 None] Group tempest-GroupsV314Test-Group-1947011101: created successfully Sep 17 07:19:27 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3fbee919-f89f-45a0-a4c4-bde672780017 tempest-GroupsV314Test-2089613031 None] Create group completed successfully. Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Flow 'volume_create_manager' (0bf8f2c9-438d-4764-9672-fdb041a7d1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1cc2967-c84f-4315-9fe2-a09408b82993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1cc2967-c84f-4315-9fe2-a09408b82993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1270426414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=98168278-3d63-4093-87c5-c092d9de0ef0,host='devstack@QuobyteHD#QuobyteHD',id=b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edfc0c92d5644cc9fec7afc9197c190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:19:30Z,use_quota=True,user_id='71e9cf6743ec4b0f907910f5f4a2760c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95524996-f780-4dec-adea-24aefb578d30),volume_type_id=95524996-f780-4dec-adea-24aefb578d30)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8063a0c-46b0-4b79-a0a6-aa32e08cacb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8063a0c-46b0-4b79-a0a6-aa32e08cacb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e563a15e-f4e9-4caa-8dcb-80a495f48d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e563a15e-f4e9-4caa-8dcb-80a495f48d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91', 'volume_name': 'volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064b5269-db4e-472d-9feb-d77b885a9650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064b5269-db4e-472d-9feb-d77b885a9650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c2bdc5-3917-446b-ab57-31b42bf05be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:29 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Volume b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91', 'volume_size': 1} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=98168278-3d63-4093-87c5-c092d9de0ef0,created_at=2026-09-17T05:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1270426414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=98168278-3d63-4093-87c5-c092d9de0ef0,host='devstack@QuobyteHD#QuobyteHD',id=b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edfc0c92d5644cc9fec7afc9197c190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:19:30Z,use_quota=True,user_id='71e9cf6743ec4b0f907910f5f4a2760c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95524996-f780-4dec-adea-24aefb578d30),volume_type_id=95524996-f780-4dec-adea-24aefb578d30)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Creating volume b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:19:29 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:19:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:29 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 1073741824 Sep 17 07:19:29 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:30 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 1073741824" returned: 0 in 0.537s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:30 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 Sep 17 07:19:30 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:30 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91" returned: 0 in 0.454s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:19:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c2bdc5-3917-446b-ab57-31b42bf05be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3969eea-8836-43a3-bc08-fee4e0ae6058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:19:31 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Volume volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 (b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91): created successfully Sep 17 07:19:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3969eea-8836-43a3-bc08-fee4e0ae6058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:19:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Flow 'volume_create_manager' (0bf8f2c9-438d-4764-9672-fdb041a7d1c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:19:31 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-46686694-f7d7-4edb-80df-d0a954d5b557 tempest-GroupsV314Test-2089613031 None] Created volume successfully. Sep 17 07:19:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:33 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Cloning volume b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 to volume 81a92582-c514-484d-88dd-474d281e20ad Sep 17 07:19:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Creating offline snapshot 2f0866d4-0b38-493e-9a23-da79d21b4f39 of volume b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:19:33 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb100997-e92c-4a42-96fc-bd2f79db4ca8]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:19:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:33 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 Sep 17 07:19:33 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:33 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91" returned: 0 in 0.435s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:33 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 1G Sep 17 07:19:33 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:34 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 1G" returned: 0 in 0.512s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:34 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 Sep 17 07:19:34 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:34 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39" returned: 0 in 0.366s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:34 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 07:19:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:34 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 Sep 17 07:19:34 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:35 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39" returned: 0 in 0.333s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:35 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.info Sep 17 07:19:35 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:35 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.info" returned: 0 in 0.267s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:35 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:35 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.info Sep 17 07:19:35 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:35 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.info" returned: 0 in 0.312s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Acquiring lock "cinder-quobyte-81a92582-c514-484d-88dd-474d281e20ad" by "_copy_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Lock "cinder-quobyte-81a92582-c514-484d-88dd-474d281e20ad" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] snapshot: 2f0866d4-0b38-493e-9a23-da79d21b4f39, volume: 81a92582-c514-484d-88dd-474d281e20ad, {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6786cd3f-4941-43ad-9a27-619dd06e1de6]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:19:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:35 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 Sep 17 07:19:35 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:36 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39" returned: 0 in 0.463s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:19:36 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b29690-9139-4aeb-97b0-3e078cea5e36]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:19:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:36 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 Sep 17 07:19:36 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:36 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91" returned: 0 in 0.442s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] will copy from snapshot at /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 07:19:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Creating direct copy from snapshot {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 07:19:36 devstack cinder-volume[86029]: DEBUG cinder.utils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Path /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad not found in is_blk_device check {{(pid=86029) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 07:19:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:36 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad Sep 17 07:19:36 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:45 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:19:45 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:19:46 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad" returned: 0 in 9.729s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:46 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91, size 1024.00 MB, duration 9.73 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:19:46 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Converted 1024.00 MB image at 105.21 MB/s Sep 17 07:19:46 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad is being set with open permissions: ugo+rw: NotImplementedError Sep 17 07:19:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:46 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad Sep 17 07:19:46 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:46 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad" returned: 0 in 0.280s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Lock "cinder-quobyte-81a92582-c514-484d-88dd-474d281e20ad" released by "_copy_volume_from_snapshot" :: held 11.027s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:19:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Acquiring lock "cinder-quobyte-2f0866d4-0b38-493e-9a23-da79d21b4f39" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:19:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Lock "cinder-quobyte-2f0866d4-0b38-493e-9a23-da79d21b4f39" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:19:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Deleting offline snapshot 2f0866d4-0b38-493e-9a23-da79d21b4f39 of volume b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:19:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] snapshot_file for this snap is: volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:19:46 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f084a1a-e3ab-44b9-9084-ec0f9b98f093]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:19:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:47 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 Sep 17 07:19:47 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:47 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39" returned: 0 in 0.552s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:19:47 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b4b4db-68cc-4820-b57d-af195d71e70b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:19:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:47 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 Sep 17 07:19:47 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:48 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91" returned: 0 in 0.695s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:48 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 Sep 17 07:19:48 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-ab726709-881a-4bd6-b297-05fee7b40d7b req-1c88ea03-e774-4c34-ad6f-abb708be95cc tempest-ServerActionsTestOtherA-1088735529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:48 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39" returned: 0 in 0.522s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:48 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39 Sep 17 07:19:48 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:49 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91.2f0866d4-0b38-493e-9a23-da79d21b4f39" returned: 0 in 0.327s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Lock "cinder-quobyte-2f0866d4-0b38-493e-9a23-da79d21b4f39" released by "_delete_snapshot" :: held 2.242s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:19:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.781s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-ab726709-881a-4bd6-b297-05fee7b40d7b req-1c88ea03-e774-4c34-ad6f-abb708be95cc tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.572s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-ab726709-881a-4bd6-b297-05fee7b40d7b req-1c88ea03-e774-4c34-ad6f-abb708be95cc tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-ab726709-881a-4bd6-b297-05fee7b40d7b req-1c88ea03-e774-4c34-ad6f-abb708be95cc tempest-ServerActionsTestOtherA-1088735529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-d25eef40-5c34-4919-a7f4-bc919a61b22a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e3751aa-c236-4c87-a381-064e6d75fb67', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:19:49 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a7b4cf33-088a-4320-aaa2-3b3ae3e7ddfa tempest-GroupsV314Test-2089613031 None] Create group from source-group-98168278-3d63-4093-87c5-c092d9de0ef0 completed successfully. Sep 17 07:19:49 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-ab726709-881a-4bd6-b297-05fee7b40d7b req-1c88ea03-e774-4c34-ad6f-abb708be95cc tempest-ServerActionsTestOtherA-1088735529 None] attachment_update completed successfully. Sep 17 07:19:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Acquiring lock "cinder-quobyte-81a92582-c514-484d-88dd-474d281e20ad" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:19:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Lock "cinder-quobyte-81a92582-c514-484d-88dd-474d281e20ad" acquired by "delete_volume" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:19:50 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0bc9ce-de35-4442-af19-70e87d3a22db]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:19:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:51 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad Sep 17 07:19:51 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:51 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad" returned: 0 in 0.843s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:51 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad Sep 17 07:19:51 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:52 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81a92582-c514-484d-88dd-474d281e20ad" returned: 0 in 0.518s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Lock "cinder-quobyte-81a92582-c514-484d-88dd-474d281e20ad" released by "delete_volume" :: held 1.490s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:19:52 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Created reservations ['54d4ea1b-826e-4c0a-af88-7b8677b3eaeb'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:19:52 devstack cinder-volume[86029]: WARNING cinder.quota [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1974233356 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1974233356, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:19:52 devstack cinder-volume[86029]: WARNING cinder.quota [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1974233356 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1974233356, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:19:52 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Created reservations ['a0957338-d66e-4be6-ac41-88d56feb402a', 'e7f5097a-0d54-4a01-b0f1-6384d8521f66', 'd7c476af-d925-47c8-b577-b6b3d0fc1d09', '589cac1d-bece-4a41-9e65-8cb9d2d68d56'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:19:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:19:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:19:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:52 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:19:52 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:53 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.353s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:53 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:19:53 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0bb47b17-e2cc-4452-94be-20ddf02d516d tempest-GroupsV314Test-2089613031 None] Delete group completed successfully. Sep 17 07:19:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Acquiring lock "cinder-quobyte-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:19:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Lock "cinder-quobyte-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91" acquired by "delete_volume" :: waited 0.052s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:19:55 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[114edb9b-fc98-440b-89a3-56af6ef41f54]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:19:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:55 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 Sep 17 07:19:55 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:56 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91" returned: 0 in 1.010s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:56 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91 Sep 17 07:19:56 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:56 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-e34f0cb2-6f2c-4db5-a7c5-c2d217c38784 req-6ed4648e-d606-4fe3-b1e3-0fcdba3454cc tempest-ServerActionsTestOtherA-1088735529 None] Terminate volume connection completed successfully. Sep 17 07:19:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-e34f0cb2-6f2c-4db5-a7c5-c2d217c38784 req-6ed4648e-d606-4fe3-b1e3-0fcdba3454cc tempest-ServerActionsTestOtherA-1088735529 None] Deleting attachment 7e3751aa-c236-4c87-a381-064e6d75fb67. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:19:56 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91" returned: 0 in 0.674s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Lock "cinder-quobyte-b8e1dd1b-60f0-43c1-91aa-d636e3d5ee91" released by "delete_volume" :: held 1.919s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:19:57 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Created reservations ['f8bf8c42-3c3d-4d51-83fd-058b573cf6d3'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:19:57 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Created reservations ['dbc4414e-ed24-4821-ac21-3f2a128539ef', 'd7cfb494-16c2-45bb-a5fa-9a55e5264ee0', '27edd8f1-3ac1-49d1-bc0e-eb474fb8ee0f', '3eff462c-eb14-40f8-9d99-e54a1e02a840'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:19:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:19:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:19:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:19:57 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:19:57 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:58 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.783s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:19:58 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:19:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-35623ad7-93a7-4ee3-bbf8-1dffd8e27f20 tempest-GroupsV314Test-2089613031 None] Delete group completed successfully. Sep 17 07:19:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-e34f0cb2-6f2c-4db5-a7c5-c2d217c38784 req-69177a7c-7611-46a4-95e1-215e532bb95f tempest-ServerActionsTestOtherA-1088735529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:19:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-e34f0cb2-6f2c-4db5-a7c5-c2d217c38784 req-69177a7c-7611-46a4-95e1-215e532bb95f tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:19:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-e34f0cb2-6f2c-4db5-a7c5-c2d217c38784 req-69177a7c-7611-46a4-95e1-215e532bb95f tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:19:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-e34f0cb2-6f2c-4db5-a7c5-c2d217c38784 req-69177a7c-7611-46a4-95e1-215e532bb95f tempest-ServerActionsTestOtherA-1088735529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-d25eef40-5c34-4919-a7f4-bc919a61b22a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b764f3bc-595e-4877-ac6b-a26400031c77', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:19:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-e34f0cb2-6f2c-4db5-a7c5-c2d217c38784 req-69177a7c-7611-46a4-95e1-215e532bb95f tempest-ServerActionsTestOtherA-1088735529 None] attachment_update completed successfully. Sep 17 07:20:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:20:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:20:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:20:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:20:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:20:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:20:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:04 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:20:04 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:05 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.893s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:20:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:20:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 8 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:20:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:20:08 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=33,cinder:UPDATE=27,cinder:INSERT=4 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:20:08 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:UPDATE=28,cinder:SELECT=31,cinder:INSERT=6 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Flow 'volume_create_manager' (ccb58b96-863c-4b57-9ee8-09a1a43ee2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c07ae9-9fa0-4eba-9034-94e50f7eacef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c07ae9-9fa0-4eba-9034-94e50f7eacef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-717399189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34aec729-45da-42f7-bf11-58b0b7cabacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d6b5afd0e2451692fd70fef8aa002e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:20:18Z,use_quota=True,user_id='d8655992608d445d997ec02da5ea6c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa683ff0-8e38-4456-8a37-aa2859d502a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa683ff0-8e38-4456-8a37-aa2859d502a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a68b02-1140-4b1f-a2d5-13c17b5bebde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a68b02-1140-4b1f-a2d5-13c17b5bebde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34aec729-45da-42f7-bf11-58b0b7cabacc', 'volume_name': 'volume-34aec729-45da-42f7-bf11-58b0b7cabacc', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6332c674-85e6-4e3d-975c-217d3679a9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6332c674-85e6-4e3d-975c-217d3679a9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef007bff-8f73-4e22-ae7a-08cc1d142d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:17 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Volume 34aec729-45da-42f7-bf11-58b0b7cabacc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34aec729-45da-42f7-bf11-58b0b7cabacc', 'volume_size': 1} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-717399189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34aec729-45da-42f7-bf11-58b0b7cabacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d6b5afd0e2451692fd70fef8aa002e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:20:18Z,use_quota=True,user_id='d8655992608d445d997ec02da5ea6c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Creating volume 34aec729-45da-42f7-bf11-58b0b7cabacc {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:20:17 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:20:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34aec729-45da-42f7-bf11-58b0b7cabacc 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:17 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34aec729-45da-42f7-bf11-58b0b7cabacc 1073741824 Sep 17 07:20:17 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:18 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34aec729-45da-42f7-bf11-58b0b7cabacc 1073741824" returned: 0 in 0.799s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34aec729-45da-42f7-bf11-58b0b7cabacc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:18 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34aec729-45da-42f7-bf11-58b0b7cabacc Sep 17 07:20:18 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Flow 'volume_create_manager' (ee1c96da-c35b-4c22-a4a1-f3be253896c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1906b8f4-571e-4e21-99f9-c3f3196d2934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1906b8f4-571e-4e21-99f9-c3f3196d2934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-762253499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c54bb2-b101-481a-9eb4-aa2ebb914035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8001eddc5a2649ff9d1aa9309bb7712f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:20:19Z,use_quota=True,user_id='9a2b533cb07f48b4992d70e0ed741a7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ec0f70-0dce-4079-8abf-166b037d343f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:19 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ec0f70-0dce-4079-8abf-166b037d343f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7029fdf0-d0ec-4b8d-a34a-e041c8779ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7029fdf0-d0ec-4b8d-a34a-e041c8779ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2c54bb2-b101-481a-9eb4-aa2ebb914035', 'volume_name': 'volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625be94c-ecea-4d5d-b679-dcbc1b4ee179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625be94c-ecea-4d5d-b679-dcbc1b4ee179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49bde5f-b35c-42e3-b17e-472e5ac87c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:19 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Volume c2c54bb2-b101-481a-9eb4-aa2ebb914035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035', 'volume_size': 1} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34aec729-45da-42f7-bf11-58b0b7cabacc" returned: 0 in 0.441s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-762253499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c54bb2-b101-481a-9eb4-aa2ebb914035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8001eddc5a2649ff9d1aa9309bb7712f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:20:19Z,use_quota=True,user_id='9a2b533cb07f48b4992d70e0ed741a7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Creating volume c2c54bb2-b101-481a-9eb4-aa2ebb914035 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:20:19 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef007bff-8f73-4e22-ae7a-08cc1d142d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34aec729-45da-42f7-bf11-58b0b7cabacc', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ffd90f6-1e2c-4685-ad61-d0a2ad9c3135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:19 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Volume volume-34aec729-45da-42f7-bf11-58b0b7cabacc (34aec729-45da-42f7-bf11-58b0b7cabacc): created successfully Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ffd90f6-1e2c-4685-ad61-d0a2ad9c3135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Flow 'volume_create_manager' (ccb58b96-863c-4b57-9ee8-09a1a43ee2bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:20:19 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035 1073741824 Sep 17 07:20:19 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:19 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1fc4a3b4-6071-485b-9241-e300c5fc31d2 tempest-AttachVolumeShelveTestJSON-572842621 None] Created volume successfully. Sep 17 07:20:20 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035 1073741824" returned: 0 in 0.923s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:20 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035 Sep 17 07:20:20 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:20 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035" returned: 0 in 0.400s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:20:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:20:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49bde5f-b35c-42e3-b17e-472e5ac87c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fb0519-7d62-48c2-9447-1cf21489c948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:20 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Volume volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035 (c2c54bb2-b101-481a-9eb4-aa2ebb914035): created successfully Sep 17 07:20:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fb0519-7d62-48c2-9447-1cf21489c948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Flow 'volume_create_manager' (ee1c96da-c35b-4c22-a4a1-f3be253896c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:20:20 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-abcbd59a-abb9-486e-89a2-5f626772c1c7 tempest-ServerRescueNegativeTestJSON-402773032 None] Created volume successfully. Sep 17 07:20:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Acquiring lock "cinder-c2c54bb2-b101-481a-9eb4-aa2ebb914035-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:20:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Lock "cinder-c2c54bb2-b101-481a-9eb4-aa2ebb914035-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:20:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Acquiring lock "cinder-quobyte-c2c54bb2-b101-481a-9eb4-aa2ebb914035" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:20:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Lock "cinder-quobyte-c2c54bb2-b101-481a-9eb4-aa2ebb914035" acquired by "delete_volume" :: waited 0.040s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:20:34 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca9990d-1d27-4720-82e6-a90d9f958635]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:20:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:34 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035 Sep 17 07:20:34 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:35 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035" returned: 0 in 0.674s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:35 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035 Sep 17 07:20:35 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:35 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c2c54bb2-b101-481a-9eb4-aa2ebb914035" returned: 0 in 0.441s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Lock "cinder-quobyte-c2c54bb2-b101-481a-9eb4-aa2ebb914035" released by "delete_volume" :: held 1.242s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:20:35 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Created reservations ['4fb7c5ad-d820-4671-a929-9de8ed752a19', '8d4ccb17-b5fd-4f40-be41-e05112e3b1d2', '70b0c3bd-b6b5-4e7a-9c76-91e0041d8c69', 'b0f1aad4-252a-436b-9696-3460025595c9'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:20:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:20:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:20:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:20:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:20:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:20:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:35 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:20:35 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:36 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-43fcb804-383c-46e8-9124-3a7958500056 req-a4ccb6f9-bf8b-4b90-8d0d-bd8991a5e83d tempest-ServerActionsTestOtherA-1088735529 None] Terminate volume connection completed successfully. Sep 17 07:20:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-43fcb804-383c-46e8-9124-3a7958500056 req-a4ccb6f9-bf8b-4b90-8d0d-bd8991a5e83d tempest-ServerActionsTestOtherA-1088735529 None] Deleting attachment b764f3bc-595e-4877-ac6b-a26400031c77. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:20:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-6dfe05f0-0d8e-4aed-867a-b348bec61f05 req-83c7495d-ddc2-4189-bf2d-929fb5daebe5 tempest-AttachVolumeShelveTestJSON-572842621 None] No connector for attachment 710cf4df-1b1d-470f-bae6-5610b88ce64d; skipping storage backend terminate_connection call. {{(pid=86029) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 17 07:20:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-6dfe05f0-0d8e-4aed-867a-b348bec61f05 req-83c7495d-ddc2-4189-bf2d-929fb5daebe5 tempest-AttachVolumeShelveTestJSON-572842621 None] Deleting attachment 710cf4df-1b1d-470f-bae6-5610b88ce64d. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:20:36 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.494s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:36 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:20:36 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Deleted volume successfully. Sep 17 07:20:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c8a64d00-687d-4551-9ef0-2e67bc3f5538 tempest-ServerRescueNegativeTestJSON-402773032 None] Lock "cinder-c2c54bb2-b101-481a-9eb4-aa2ebb914035-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:20:45 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:20:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Flow 'volume_create_manager' (873f6738-10fe-48fe-a8e4-19b8231033e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:20:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d242edf8-8679-447b-a2c2-e510b0f8d56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d242edf8-8679-447b-a2c2-e510b0f8d56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-959947627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec37a0c-d977-4fa1-9896-f14fe118e623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61b7b4747564e66a5b0be87a56b5c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:20:45Z,use_quota=True,user_id='94fcc053fbef4a7aa16698af3b4416b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6c11aa-5f25-4d25-8d98-b12be7978990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6c11aa-5f25-4d25-8d98-b12be7978990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03e05a6-e3a3-4ea6-baf3-ef68df8a7ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:45 devstack cinder-volume[86029]: DEBUG cinder.image.glance [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Creating Keystone auth plugin from conf {{(pid=86029) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Flow 'volume_create_manager' (d72199fd-89ee-499a-af6d-1e948f88476b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2a9a1d-21c5-494b-8d29-c490dcc069bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2a9a1d-21c5-494b-8d29-c490dcc069bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-707649494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e49d441e0fb3430582f08e635cfc3464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:20:47Z,use_quota=True,user_id='bf051ac19f46489d91c5d5996944f0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e857e73-8520-4cf5-b574-8907b21f60e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e857e73-8520-4cf5-b574-8907b21f60e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c638927a-30c2-4b91-9350-784ddb5b82e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c638927a-30c2-4b91-9350-784ddb5b82e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6', 'volume_name': 'volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f878230-fd5b-47ad-8c26-c0d5c10c4a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f878230-fd5b-47ad-8c26-c0d5c10c4a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460468a3-6282-478c-9554-e4f210cb682f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:46 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Volume 4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6', 'volume_size': 1} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-707649494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e49d441e0fb3430582f08e635cfc3464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:20:47Z,use_quota=True,user_id='bf051ac19f46489d91c5d5996944f0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Creating volume 4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:20:46 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:46 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6 1073741824 Sep 17 07:20:46 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03e05a6-e3a3-4ea6-baf3-ef68df8a7ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ec37a0c-d977-4fa1-9896-f14fe118e623', 'volume_name': 'volume-1ec37a0c-d977-4fa1-9896-f14fe118e623', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8104b20f-c0d8-4c15-9892-119af92dcc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8104b20f-c0d8-4c15-9892-119af92dcc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75bac19-7967-43cd-930e-eef4491d58ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:46 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Volume 1ec37a0c-d977-4fa1-9896-f14fe118e623: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ec37a0c-d977-4fa1-9896-f14fe118e623', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 07:20:46 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Trying to clone 1ec37a0c-d977-4fa1-9896-f14fe118e623 from image d174ccf1-c953-4210-b592-ccde541c6f06 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]). {{(pid=86029) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_2bycmlvsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 07:20:47 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Image download 20.69 MB at 20.69 MB/s Sep 17 07:20:47 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6 1073741824" returned: 0 in 0.604s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa32ff08-4db0-4722-862d-9ac6522c4b31]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_2bycmlvsdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:47 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6 Sep 17 07:20:47 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:47 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_2bycmlvsdevstack@QuobyteHD Sep 17 07:20:47 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:47 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6" returned: 0 in 0.320s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:20:47 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_2bycmlvsdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Temporary image d174ccf1-c953-4210-b592-ccde541c6f06 is fetched for user 94fcc053fbef4a7aa16698af3b4416b0. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460468a3-6282-478c-9554-e4f210cb682f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd98fc1-f0da-4872-a74a-e8919243b44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc048ded-c91b-48a7-b1fa-c7edfa4c79fc]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_2bycmlvsdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:47 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Volume volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6 (4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6): created successfully Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd98fc1-f0da-4872-a74a-e8919243b44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Flow 'volume_create_manager' (d72199fd-89ee-499a-af6d-1e948f88476b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:20:47 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d3370a07-f87b-48e4-a80b-5fc766afef0f tempest-VolumeQuotasNegativeTestJSON-117979844 None] Created volume successfully. Sep 17 07:20:48 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_2bycmlvsdevstack@QuobyteHD Sep 17 07:20:48 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:48 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_2bycmlvsdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:20:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:20:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-959947627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec37a0c-d977-4fa1-9896-f14fe118e623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61b7b4747564e66a5b0be87a56b5c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:20:45Z,use_quota=True,user_id='94fcc053fbef4a7aa16698af3b4416b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:20:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Creating volume 1ec37a0c-d977-4fa1-9896-f14fe118e623 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:20:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:20:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:20:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:20:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:20:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:20:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:20:48 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:20:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:48 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 1073741824 Sep 17 07:20:48 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:48 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 1073741824" returned: 0 in 0.525s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:48 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 Sep 17 07:20:48 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:49 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623" returned: 0 in 0.300s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:20:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:20:49 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Attempting download of d174ccf1-c953-4210-b592-ccde541c6f06 ((None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}])) to volume 1ec37a0c-d977-4fa1-9896-f14fe118e623. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 07:20:49 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a25472-1990-49d9-a284-7d645388988c]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:20:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_h8yrumc8 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:49 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_h8yrumc8 Sep 17 07:20:49 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:49 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_h8yrumc8" returned: 0 in 0.384s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_h8yrumc8 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:49 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_h8yrumc8 Sep 17 07:20:49 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:50 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_h8yrumc8" returned: 1 in 0.398s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_h8yrumc8' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[094a6299-1588-4e4c-9bfc-1f0b8aae46a9]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_2bycmlvsdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Acquiring lock "cinder-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Lock "cinder-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Acquiring lock "cinder-quobyte-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Lock "cinder-quobyte-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5510fe7b-deba-433c-b5c7-f391375fa18b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:50 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_2bycmlvsdevstack@QuobyteHD Sep 17 07:20:50 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:50 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6 Sep 17 07:20:50 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:50 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_2bycmlvsdevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] d174ccf1-c953-4210-b592-ccde541c6f06 was qcow2, converting to qcow2 {{(pid=86029) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_2bycmlvsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:50 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_2bycmlvsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 Sep 17 07:20:50 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:50 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6" returned: 0 in 0.476s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:50 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6 Sep 17 07:20:50 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:51 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6" returned: 0 in 0.355s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Lock "cinder-quobyte-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6" released by "delete_volume" :: held 0.886s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:20:51 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Created reservations ['e916e2d9-1c14-4db4-82a6-fa771b990ae1', '07155f87-4e1a-4e8c-a1c0-a4fdefa39d52', '8ea583d2-338e-48b6-b550-6ff3b279ee81', '3fedb0b8-d806-4461-968a-237591250212'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:20:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:20:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:20:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:20:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:20:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:20:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:51 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:20:51 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:51 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.364s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:51 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:20:51 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Deleted volume successfully. Sep 17 07:20:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0557c83a-ed2d-46fe-b91e-1eae858a2d4d tempest-VolumeQuotasNegativeTestJSON-117979844 None] Lock "cinder-4e72f1b4-75ff-4664-a5e2-ed4eb3dcebd6-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:20:53 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_2bycmlvsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623" returned: 0 in 3.417s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:53 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_2bycmlvsdevstack@QuobyteHD, size 112.00 MB, duration 3.42 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:20:53 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Converted 112.00 MB image at 32.75 MB/s Sep 17 07:20:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:20:53 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 1G Sep 17 07:20:53 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:54 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 1G" returned: 0 in 0.567s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:20:54 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Downloaded image d174ccf1-c953-4210-b592-ccde541c6f06 ((None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}])) to volume 1ec37a0c-d977-4fa1-9896-f14fe118e623 successfully. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 07:20:54 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Temporary image d174ccf1-c953-4210-b592-ccde541c6f06 for user 94fcc053fbef4a7aa16698af3b4416b0 is deleted. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 07:20:54 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Marking volume 1ec37a0c-d977-4fa1-9896-f14fe118e623 as bootable. {{(pid=86029) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 07:20:54 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Copying metadata from image d174ccf1-c953-4210-b592-ccde541c6f06 to 1ec37a0c-d977-4fa1-9896-f14fe118e623. {{(pid=86029) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 07:20:54 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Creating volume glance metadata for volume 1ec37a0c-d977-4fa1-9896-f14fe118e623 backed by image d174ccf1-c953-4210-b592-ccde541c6f06 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86029) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 07:20:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75bac19-7967-43cd-930e-eef4491d58ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec37a0c-d977-4fa1-9896-f14fe118e623', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb2b208-7fdf-4780-8fb2-0a8a1b65bfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:20:54 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Volume volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 (1ec37a0c-d977-4fa1-9896-f14fe118e623): created successfully Sep 17 07:20:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb2b208-7fdf-4780-8fb2-0a8a1b65bfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:20:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Flow 'volume_create_manager' (873f6738-10fe-48fe-a8e4-19b8231033e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:20:54 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-7b4ac92a-0176-4970-acb8-b72586117eb0 tempest-ServerActionsTestOtherA-1088735529 None] Created volume successfully. Sep 17 07:20:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-84a9ecae-4070-4d71-96cc-d0e0ec0c8a18 req-f1b51133-f3cd-47eb-9527-119600026e26 tempest-ServerActionsTestOtherA-1088735529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:20:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-84a9ecae-4070-4d71-96cc-d0e0ec0c8a18 req-f1b51133-f3cd-47eb-9527-119600026e26 tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:20:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-84a9ecae-4070-4d71-96cc-d0e0ec0c8a18 req-f1b51133-f3cd-47eb-9527-119600026e26 tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:20:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-84a9ecae-4070-4d71-96cc-d0e0ec0c8a18 req-f1b51133-f3cd-47eb-9527-119600026e26 tempest-ServerActionsTestOtherA-1088735529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-1ec37a0c-d977-4fa1-9896-f14fe118e623', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bfc1b0d-ecad-4db7-93a8-e7c7d17789d4', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:20:59 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-84a9ecae-4070-4d71-96cc-d0e0ec0c8a18 req-f1b51133-f3cd-47eb-9527-119600026e26 tempest-ServerActionsTestOtherA-1088735529 None] attachment_update completed successfully. Sep 17 07:21:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:21:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:21:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:21:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:21:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:21:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:21:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:04 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:21:04 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:05 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.765s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:21:09 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=26,cinder:UPDATE=35,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:21:09 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:UPDATE=28,cinder:SELECT=43,cinder:DELETE=3,cinder:INSERT=12 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:21:19 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-3c31fc99-680e-4dd8-86bb-b813a5544413 req-2ec04480-d286-4004-b240-dc96bd576cd9 tempest-ServerActionsTestOtherA-1088735529 None] Terminate volume connection completed successfully. Sep 17 07:21:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3c31fc99-680e-4dd8-86bb-b813a5544413 req-2ec04480-d286-4004-b240-dc96bd576cd9 tempest-ServerActionsTestOtherA-1088735529 None] Deleting attachment 6bfc1b0d-ecad-4db7-93a8-e7c7d17789d4. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:21:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-3c31fc99-680e-4dd8-86bb-b813a5544413 req-028314a2-a5ae-4ee6-8844-01477d1ad90e tempest-ServerActionsTestOtherA-1088735529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:21:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-3c31fc99-680e-4dd8-86bb-b813a5544413 req-028314a2-a5ae-4ee6-8844-01477d1ad90e tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:21:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-3c31fc99-680e-4dd8-86bb-b813a5544413 req-028314a2-a5ae-4ee6-8844-01477d1ad90e tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:21:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3c31fc99-680e-4dd8-86bb-b813a5544413 req-028314a2-a5ae-4ee6-8844-01477d1ad90e tempest-ServerActionsTestOtherA-1088735529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-1ec37a0c-d977-4fa1-9896-f14fe118e623', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0312e71-5c50-4319-930e-6e2bd4f07160', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:21:22 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-3c31fc99-680e-4dd8-86bb-b813a5544413 req-028314a2-a5ae-4ee6-8844-01477d1ad90e tempest-ServerActionsTestOtherA-1088735529 None] attachment_update completed successfully. Sep 17 07:21:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Acquiring lock "cinder-34aec729-45da-42f7-bf11-58b0b7cabacc-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:21:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Lock "cinder-34aec729-45da-42f7-bf11-58b0b7cabacc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:21:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Acquiring lock "cinder-quobyte-34aec729-45da-42f7-bf11-58b0b7cabacc" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:21:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Lock "cinder-quobyte-34aec729-45da-42f7-bf11-58b0b7cabacc" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:21:22 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee1fb23-dd4c-4b75-9912-96ba3bddd241]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:21:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34aec729-45da-42f7-bf11-58b0b7cabacc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:23 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34aec729-45da-42f7-bf11-58b0b7cabacc Sep 17 07:21:23 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:23 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34aec729-45da-42f7-bf11-58b0b7cabacc" returned: 0 in 0.473s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34aec729-45da-42f7-bf11-58b0b7cabacc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:23 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34aec729-45da-42f7-bf11-58b0b7cabacc Sep 17 07:21:23 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:23 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34aec729-45da-42f7-bf11-58b0b7cabacc" returned: 0 in 0.452s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Lock "cinder-quobyte-34aec729-45da-42f7-bf11-58b0b7cabacc" released by "delete_volume" :: held 0.999s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:21:24 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Created reservations ['e951fe6f-53bb-49b4-87e7-e8c9e8bfe4cc', '7efd1728-67bd-4801-82e1-361f53eb7702', 'cead8bb4-1d21-485c-8c46-42277fa5bf1c', 'e3ca65b4-0e84-4c8e-a23b-cdc1087dcc37'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:21:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:21:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:21:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:21:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:21:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:21:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:24 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:21:24 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:24 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.475s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:24 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:21:24 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Deleted volume successfully. Sep 17 07:21:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dc0da4df-d064-45b5-a927-77643a84d4b5 tempest-AttachVolumeShelveTestJSON-572842621 None] Lock "cinder-34aec729-45da-42f7-bf11-58b0b7cabacc-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Flow 'volume_create_manager' (ee0315c1-cbd0-4a35-87da-3a2c22908984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3a3d09-80b3-4da4-8a54-99ada0fb4186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3a3d09-80b3-4da4-8a54-99ada0fb4186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-64160462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c8eebd-3e8f-4abe-adbc-ef657f3a4b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6ba8f6576949afbb1d8ae474533079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:21:33Z,use_quota=True,user_id='b81f9f71a1544e939cfedd891266607d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a715bf-b85d-4650-b199-5552375a7368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a715bf-b85d-4650-b199-5552375a7368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ea2e6b-8db7-4d78-9941-7a2794b0f9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ea2e6b-8db7-4d78-9941-7a2794b0f9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02c8eebd-3e8f-4abe-adbc-ef657f3a4b53', 'volume_name': 'volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223b6e07-4541-4dd4-80e5-720206de099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223b6e07-4541-4dd4-80e5-720206de099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593efc54-5088-4221-9c1f-1422f5ab905e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:33 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Volume 02c8eebd-3e8f-4abe-adbc-ef657f3a4b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53', 'volume_size': 1} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-64160462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c8eebd-3e8f-4abe-adbc-ef657f3a4b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6ba8f6576949afbb1d8ae474533079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:21:33Z,use_quota=True,user_id='b81f9f71a1544e939cfedd891266607d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Creating volume 02c8eebd-3e8f-4abe-adbc-ef657f3a4b53 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:21:33 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:21:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:33 devstack sudo[92206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53 1073741824 Sep 17 07:21:33 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:35 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53 1073741824" returned: 0 in 1.187s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:35 devstack sudo[92221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53 Sep 17 07:21:35 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:35 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53" returned: 0 in 0.607s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:21:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:21:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593efc54-5088-4221-9c1f-1422f5ab905e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d5326d-fa9f-468d-b211-4699c60191db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:36 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Volume volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53 (02c8eebd-3e8f-4abe-adbc-ef657f3a4b53): created successfully Sep 17 07:21:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d5326d-fa9f-468d-b211-4699c60191db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Flow 'volume_create_manager' (ee0315c1-cbd0-4a35-87da-3a2c22908984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:21:36 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a712e3b2-9d2c-4f93-9c72-b11bc58ee5a8 tempest-VolumesTransfersV357Test-1089148443 None] Created volume successfully. Sep 17 07:21:39 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-863a680f-d6fc-4413-b8d7-ce2a847684a2 tempest-VolumesTransfersV357Test-690668525 None] Transfer volume completed successfully. Sep 17 07:21:40 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Acquiring lock "cinder-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:21:40 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Lock "cinder-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:21:40 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Acquiring lock "cinder-quobyte-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:21:40 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Lock "cinder-quobyte-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53" acquired by "delete_volume" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:21:40 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf58b05-cc7d-4ed5-9e2b-c2f882c01dbe]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:21:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:40 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53 Sep 17 07:21:40 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:41 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53" returned: 0 in 0.639s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:41 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53 Sep 17 07:21:41 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:41 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53" returned: 0 in 0.357s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Lock "cinder-quobyte-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53" released by "delete_volume" :: held 1.091s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:21:41 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Created reservations ['34d6e5a4-a9a3-445c-97d9-e3d707f094c2', '614c3413-599a-4515-bf8f-14334c959dcd', 'b0ecdd36-9ec8-471c-a1a6-9c76ba6797f9', '01d20817-669a-4a8e-97ac-fd32d6b52653'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:21:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:21:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:21:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:21:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:21:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:21:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:41 devstack sudo[92238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:21:41 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:41 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Flow 'volume_create_manager' (0a64f818-b9c1-45f8-bbad-ecce990399f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92217856-f23c-4c8a-b3d5-849e030e08b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92217856-f23c-4c8a-b3d5-849e030e08b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1713070762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5649a6df-3702-4678-887b-5827b844a7a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c97cfc5e31e4411ae87214273211e06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:21:42Z,use_quota=True,user_id='01c9c48bcd9c461984e001c623a70da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a478e087-efa1-4397-9251-a2401172336e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a478e087-efa1-4397-9251-a2401172336e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072c4cf8-51d4-4501-b778-e3b2772e6445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072c4cf8-51d4-4501-b778-e3b2772e6445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5649a6df-3702-4678-887b-5827b844a7a7', 'volume_name': 'volume-5649a6df-3702-4678-887b-5827b844a7a7', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35b486c-0e60-4123-b96f-f8b39e3a9852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35b486c-0e60-4123-b96f-f8b39e3a9852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad61915a-5acf-4afa-9abc-e033e09284ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:42 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Volume 5649a6df-3702-4678-887b-5827b844a7a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5649a6df-3702-4678-887b-5827b844a7a7', 'volume_size': 1} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1713070762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5649a6df-3702-4678-887b-5827b844a7a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c97cfc5e31e4411ae87214273211e06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:21:42Z,use_quota=True,user_id='01c9c48bcd9c461984e001c623a70da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Creating volume 5649a6df-3702-4678-887b-5827b844a7a7 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:21:42 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5649a6df-3702-4678-887b-5827b844a7a7 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:42 devstack sudo[92240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5649a6df-3702-4678-887b-5827b844a7a7 1073741824 Sep 17 07:21:42 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:42 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.422s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:21:42 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Deleted volume successfully. Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8354d1ff-49d2-4e0b-bfd8-5cc4b3cd6c01 tempest-VolumesTransfersV357Test-1745272828 None] Lock "cinder-02c8eebd-3e8f-4abe-adbc-ef657f3a4b53-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:21:42 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5649a6df-3702-4678-887b-5827b844a7a7 1073741824" returned: 0 in 0.460s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5649a6df-3702-4678-887b-5827b844a7a7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:42 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5649a6df-3702-4678-887b-5827b844a7a7 Sep 17 07:21:42 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:42 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5649a6df-3702-4678-887b-5827b844a7a7" returned: 0 in 0.346s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad61915a-5acf-4afa-9abc-e033e09284ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5649a6df-3702-4678-887b-5827b844a7a7', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8661e1-b46a-4ddd-a8b7-4e506f6b6da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:43 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Volume volume-5649a6df-3702-4678-887b-5827b844a7a7 (5649a6df-3702-4678-887b-5827b844a7a7): created successfully Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8661e1-b46a-4ddd-a8b7-4e506f6b6da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Flow 'volume_create_manager' (0a64f818-b9c1-45f8-bbad-ecce990399f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:21:43 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-3171a7bd-2666-403e-8bfa-abc4147e826e req-6785996d-4323-45e1-bc99-39019b1a04a8 tempest-VolumesGetTestJSON-1129211314 None] Created volume successfully. Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Flow 'volume_create_manager' (d6327551-a6aa-456a-9871-e027984bc9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c41aa4e-d118-4511-9d53-c5311f0fa52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c41aa4e-d118-4511-9d53-c5311f0fa52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1294790234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c495caa3-99c5-4a33-a977-a8a609dcdf42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6ba8f6576949afbb1d8ae474533079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:21:44Z,use_quota=True,user_id='b81f9f71a1544e939cfedd891266607d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072cebf2-9366-4b6d-9c3b-a36adead4d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072cebf2-9366-4b6d-9c3b-a36adead4d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd37a19-f168-4f00-b2e8-91133a6de5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd37a19-f168-4f00-b2e8-91133a6de5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c495caa3-99c5-4a33-a977-a8a609dcdf42', 'volume_name': 'volume-c495caa3-99c5-4a33-a977-a8a609dcdf42', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8562f3-bc01-4e64-8f51-2fcff0759ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8562f3-bc01-4e64-8f51-2fcff0759ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889ccb1c-64a2-43d8-8fbe-3f9b42c2b120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:43 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Volume c495caa3-99c5-4a33-a977-a8a609dcdf42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c495caa3-99c5-4a33-a977-a8a609dcdf42', 'volume_size': 1} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1294790234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c495caa3-99c5-4a33-a977-a8a609dcdf42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6ba8f6576949afbb1d8ae474533079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:21:44Z,use_quota=True,user_id='b81f9f71a1544e939cfedd891266607d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Creating volume c495caa3-99c5-4a33-a977-a8a609dcdf42 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:21:43 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:21:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c495caa3-99c5-4a33-a977-a8a609dcdf42 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:43 devstack sudo[92311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c495caa3-99c5-4a33-a977-a8a609dcdf42 1073741824 Sep 17 07:21:43 devstack sudo[92311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:44 devstack sudo[92311]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c495caa3-99c5-4a33-a977-a8a609dcdf42 1073741824" returned: 0 in 0.674s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Acquiring lock "cinder-5649a6df-3702-4678-887b-5827b844a7a7-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c495caa3-99c5-4a33-a977-a8a609dcdf42 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Lock "cinder-5649a6df-3702-4678-887b-5827b844a7a7-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:21:44 devstack sudo[92318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c495caa3-99c5-4a33-a977-a8a609dcdf42 Sep 17 07:21:44 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Acquiring lock "cinder-quobyte-5649a6df-3702-4678-887b-5827b844a7a7" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Lock "cinder-quobyte-5649a6df-3702-4678-887b-5827b844a7a7" acquired by "delete_volume" :: waited 0.033s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[82694cfb-e5c9-459e-8325-ce6862051cf6]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5649a6df-3702-4678-887b-5827b844a7a7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:44 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c495caa3-99c5-4a33-a977-a8a609dcdf42" returned: 0 in 0.369s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889ccb1c-64a2-43d8-8fbe-3f9b42c2b120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c495caa3-99c5-4a33-a977-a8a609dcdf42', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c26eb5-0b87-457c-9421-7bec61553b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:44 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Volume volume-c495caa3-99c5-4a33-a977-a8a609dcdf42 (c495caa3-99c5-4a33-a977-a8a609dcdf42): created successfully Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c26eb5-0b87-457c-9421-7bec61553b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Flow 'volume_create_manager' (d6327551-a6aa-456a-9871-e027984bc9cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:21:44 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5649a6df-3702-4678-887b-5827b844a7a7 Sep 17 07:21:44 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:44 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-79c116c9-e1ca-4b4d-8e34-59e869c0555a tempest-VolumesTransfersV357Test-1089148443 None] Created volume successfully. Sep 17 07:21:45 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5649a6df-3702-4678-887b-5827b844a7a7" returned: 0 in 0.548s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5649a6df-3702-4678-887b-5827b844a7a7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:45 devstack sudo[92327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5649a6df-3702-4678-887b-5827b844a7a7 Sep 17 07:21:45 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:45 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5649a6df-3702-4678-887b-5827b844a7a7" returned: 0 in 0.291s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Lock "cinder-quobyte-5649a6df-3702-4678-887b-5827b844a7a7" released by "delete_volume" :: held 0.939s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:21:45 devstack cinder-volume[86029]: DEBUG cinder.quota [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Created reservations ['b4899d01-7b60-4a94-b595-0515754cb52d', '2f5bfa11-673e-405b-bc36-80d2c982ddc2', '8dd4a066-95e6-406b-869a-fc9cb1975cce', '8189ff5c-27d8-4385-a327-b9affc385b46'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:21:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:21:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:21:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:21:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:21:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:21:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:45 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:21:45 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:46 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.491s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:46 devstack cinder-volume[86029]: DEBUG cinder.manager [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:21:46 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Deleted volume successfully. Sep 17 07:21:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-fdb73fb1-34d1-4c38-bda1-f4cb3264a1a9 req-e9559820-4428-46f7-a3c1-7b45a40fde82 tempest-VolumesGetTestJSON-1129211314 None] Lock "cinder-5649a6df-3702-4678-887b-5827b844a7a7-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:21:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Acquiring lock "cinder-c495caa3-99c5-4a33-a977-a8a609dcdf42-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:21:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Lock "cinder-c495caa3-99c5-4a33-a977-a8a609dcdf42-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:21:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Acquiring lock "cinder-quobyte-c495caa3-99c5-4a33-a977-a8a609dcdf42" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:21:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Lock "cinder-quobyte-c495caa3-99c5-4a33-a977-a8a609dcdf42" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:21:46 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6532b9e5-a4c1-4a0a-892b-854eb8a2387e]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:21:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c495caa3-99c5-4a33-a977-a8a609dcdf42 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:46 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c495caa3-99c5-4a33-a977-a8a609dcdf42 Sep 17 07:21:46 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:46 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c495caa3-99c5-4a33-a977-a8a609dcdf42" returned: 0 in 0.399s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c495caa3-99c5-4a33-a977-a8a609dcdf42 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:46 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c495caa3-99c5-4a33-a977-a8a609dcdf42 Sep 17 07:21:46 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:47 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c495caa3-99c5-4a33-a977-a8a609dcdf42" returned: 0 in 0.291s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:47 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Lock "cinder-quobyte-c495caa3-99c5-4a33-a977-a8a609dcdf42" released by "delete_volume" :: held 0.754s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:21:47 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Created reservations ['82e2cb8c-9f88-4785-9855-f1a02b021a5a', 'd99e2e31-81e7-4cb0-b7d2-154aae838536', '6e29d062-235a-4fd3-8a7b-19698318152f', 'ee5b4415-1e48-4a5a-ae02-5b694fc44971'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:21:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:21:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:21:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:21:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:21:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:21:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:47 devstack sudo[92349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:21:47 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:47 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.331s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:21:47 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:21:47 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Deleted volume successfully. Sep 17 07:21:47 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-20fbd716-b6d3-46ce-be47-b8fc50a86fb6 tempest-VolumesTransfersV357Test-1745272828 None] Lock "cinder-c495caa3-99c5-4a33-a977-a8a609dcdf42-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:21:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-83855612-25f2-4699-a4cc-1883cc4aa70a tempest-BackendsCapabilitiesAdminTestsJSON-1398921358 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8438682556152, 'free_capacity_gb': 1775.8438682556152, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86029) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 07:21:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3744ea4-65c7-477c-ae3c-228c18b23081 tempest-BackendsCapabilitiesAdminTestsJSON-1398921358 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8438682556152, 'free_capacity_gb': 1775.8438682556152, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86029) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 07:21:57 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=33,cinder:UPDATE=46,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:21:57 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=35,cinder:UPDATE=39,cinder:INSERT=7,cinder:DELETE=4 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:21:57 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-16a7b50b-031a-421e-aeca-c1d5c762b523 tempest-GroupSnapshotsTest-2103732326 None] Group tempest-GroupSnapshotsTest-Group-2059099550: creating Sep 17 07:21:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-16a7b50b-031a-421e-aeca-c1d5c762b523 tempest-GroupSnapshotsTest-2103732326 None] Group tempest-GroupSnapshotsTest-Group-2059099550: created successfully Sep 17 07:21:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-16a7b50b-031a-421e-aeca-c1d5c762b523 tempest-GroupSnapshotsTest-2103732326 None] Create group completed successfully. Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Flow 'volume_create_manager' (84261967-6586-4c99-8cbf-a596ee9702a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44dbc021-0ee9-49f8-b17b-89101ead55ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44dbc021-0ee9-49f8-b17b-89101ead55ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-92975005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ce50be0-6f86-436b-bfd6-5791d0562474,host='devstack@QuobyteHD#QuobyteHD',id=7027f81e-6884-4e47-b94c-89e2ad0fef45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='997d007bd7fb4bb485c52bb59bc9217a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:22:00Z,use_quota=True,user_id='fc89eb0410514be5ac9dfa9fe4fbea05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ebe0bbd-f2f8-49a0-bd7f-de1259bafc07),volume_type_id=4ebe0bbd-f2f8-49a0-bd7f-de1259bafc07)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59dceb85-c922-4328-b4c9-6023029e681a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59dceb85-c922-4328-b4c9-6023029e681a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c25ed9-23b5-4e59-9307-75e0086e64c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c25ed9-23b5-4e59-9307-75e0086e64c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7027f81e-6884-4e47-b94c-89e2ad0fef45', 'volume_name': 'volume-7027f81e-6884-4e47-b94c-89e2ad0fef45', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e34b3b-7fed-4d4f-a2a3-9e3d79d385ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e34b3b-7fed-4d4f-a2a3-9e3d79d385ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67972dc4-7800-4a15-b277-d06d300a410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:21:59 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Volume 7027f81e-6884-4e47-b94c-89e2ad0fef45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7027f81e-6884-4e47-b94c-89e2ad0fef45', 'volume_size': 1} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3ce50be0-6f86-436b-bfd6-5791d0562474,created_at=2026-09-17T05:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-92975005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ce50be0-6f86-436b-bfd6-5791d0562474,host='devstack@QuobyteHD#QuobyteHD',id=7027f81e-6884-4e47-b94c-89e2ad0fef45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='997d007bd7fb4bb485c52bb59bc9217a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:22:00Z,use_quota=True,user_id='fc89eb0410514be5ac9dfa9fe4fbea05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ebe0bbd-f2f8-49a0-bd7f-de1259bafc07),volume_type_id=4ebe0bbd-f2f8-49a0-bd7f-de1259bafc07)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Creating volume 7027f81e-6884-4e47-b94c-89e2ad0fef45 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:21:59 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:21:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:21:59 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 1073741824 Sep 17 07:21:59 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-2b4bea37-7363-4394-ac58-e65c432df515 req-d30be91f-ffdc-4f4d-82fc-b1ef99123b2c tempest-ServerActionsTestOtherA-1088735529 None] Terminate volume connection completed successfully. Sep 17 07:22:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-2b4bea37-7363-4394-ac58-e65c432df515 req-d30be91f-ffdc-4f4d-82fc-b1ef99123b2c tempest-ServerActionsTestOtherA-1088735529 None] Deleting attachment e0312e71-5c50-4319-930e-6e2bd4f07160. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:22:00 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 1073741824" returned: 0 in 0.725s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:00 devstack sudo[92426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 Sep 17 07:22:00 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Acquiring lock "cinder-1ec37a0c-d977-4fa1-9896-f14fe118e623-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Lock "cinder-1ec37a0c-d977-4fa1-9896-f14fe118e623-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Acquiring lock "cinder-quobyte-1ec37a0c-d977-4fa1-9896-f14fe118e623" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Lock "cinder-quobyte-1ec37a0c-d977-4fa1-9896-f14fe118e623" acquired by "delete_volume" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:00 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[08df39da-d6b8-41eb-9f1c-86f3fc873796]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:01 devstack sudo[92428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 Sep 17 07:22:01 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:01 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45" returned: 0 in 0.669s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67972dc4-7800-4a15-b277-d06d300a410d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7027f81e-6884-4e47-b94c-89e2ad0fef45', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2b3222-7d6b-43d4-add5-7c960a7394ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:01 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Volume volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 (7027f81e-6884-4e47-b94c-89e2ad0fef45): created successfully Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2b3222-7d6b-43d4-add5-7c960a7394ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Flow 'volume_create_manager' (84261967-6586-4c99-8cbf-a596ee9702a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:22:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-fdd3d9d3-f6d7-47de-a049-e949fe8efe7e tempest-GroupSnapshotsTest-2103732326 None] Created volume successfully. Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Flow 'volume_create_manager' (a4c88b6a-b9bb-4e64-9dbe-f38ff837e298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:22:01 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c12b26-1c1c-4ac7-bbd0-2658fc5fbdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623" returned: 0 in 0.630s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c12b26-1c1c-4ac7-bbd0-2658fc5fbdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-766769288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f06e285-d2eb-4ee8-acec-e25124614141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23dd9b1144fa4fdaa98a7c07322f8108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:22:01Z,use_quota=True,user_id='294ceb58122942b39bec08ea3585625b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:01 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623 Sep 17 07:22:01 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4633e9bf-c052-4ee2-a8bb-1720ef29a52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4633e9bf-c052-4ee2-a8bb-1720ef29a52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af14db2-6139-43ec-93af-ab379bbab1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af14db2-6139-43ec-93af-ab379bbab1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f06e285-d2eb-4ee8-acec-e25124614141', 'volume_name': 'volume-5f06e285-d2eb-4ee8-acec-e25124614141', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc90813f-0454-4c08-b5ba-413974cff5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc90813f-0454-4c08-b5ba-413974cff5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4402d39b-2cc1-4a2c-a42b-2162ef762543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:01 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Volume 5f06e285-d2eb-4ee8-acec-e25124614141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f06e285-d2eb-4ee8-acec-e25124614141', 'volume_size': 1} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-766769288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f06e285-d2eb-4ee8-acec-e25124614141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23dd9b1144fa4fdaa98a7c07322f8108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:22:01Z,use_quota=True,user_id='294ceb58122942b39bec08ea3585625b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Creating volume 5f06e285-d2eb-4ee8-acec-e25124614141 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:22:01 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f06e285-d2eb-4ee8-acec-e25124614141 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:01 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f06e285-d2eb-4ee8-acec-e25124614141 1073741824 Sep 17 07:22:01 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Acquiring lock "cinder-d25eef40-5c34-4919-a7f4-bc919a61b22a-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Lock "cinder-d25eef40-5c34-4919-a7f4-bc919a61b22a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Acquiring lock "cinder-quobyte-d25eef40-5c34-4919-a7f4-bc919a61b22a" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Lock "cinder-quobyte-d25eef40-5c34-4919-a7f4-bc919a61b22a" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:01 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1ec37a0c-d977-4fa1-9896-f14fe118e623" returned: 0 in 0.412s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Lock "cinder-quobyte-1ec37a0c-d977-4fa1-9896-f14fe118e623" released by "delete_volume" :: held 1.131s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[def1f4c1-a79e-43c6-9d99-a5e026cbecfb]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d25eef40-5c34-4919-a7f4-bc919a61b22a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG cinder.quota [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Created reservations ['09c79131-fc3e-45dc-ba33-7ecee1acae7c', '5ea3d3ac-898e-4286-a712-dd6c27014510', '0179a71e-d6d5-4392-b784-07f9e177bad7', '2ad1ec72-daca-4d55-b1a2-9d924f0b0c16'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:22:02 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d25eef40-5c34-4919-a7f4-bc919a61b22a Sep 17 07:22:02 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:02 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:22:02 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:02 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f06e285-d2eb-4ee8-acec-e25124614141 1073741824" returned: 0 in 0.776s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f06e285-d2eb-4ee8-acec-e25124614141 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:02 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f06e285-d2eb-4ee8-acec-e25124614141 Sep 17 07:22:02 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:02 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d25eef40-5c34-4919-a7f4-bc919a61b22a" returned: 0 in 0.682s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d25eef40-5c34-4919-a7f4-bc919a61b22a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:02 devstack sudo[92454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d25eef40-5c34-4919-a7f4-bc919a61b22a Sep 17 07:22:02 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:02 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.538s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG cinder.manager [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:22:02 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Deleted volume successfully. Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-2b4bea37-7363-4394-ac58-e65c432df515 req-c3b98000-6fb7-4fa4-89ba-422e13891e3a tempest-ServerActionsTestOtherA-1088735529 None] Lock "cinder-1ec37a0c-d977-4fa1-9896-f14fe118e623-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:02 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] GroupSnapshot d11f4277-1b4d-40d2-b3fe-0f726bce3672: creating. Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] Group snapshot d11f4277-1b4d-40d2-b3fe-0f726bce3672: creating. {{(pid=86029) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 07:22:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:03 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f06e285-d2eb-4ee8-acec-e25124614141" returned: 0 in 0.527s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.069s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4402d39b-2cc1-4a2c-a42b-2162ef762543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f06e285-d2eb-4ee8-acec-e25124614141', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a34efa-c89c-4c4f-8559-673b3ba30162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] Creating offline snapshot 7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d of volume 7027f81e-6884-4e47-b94c-89e2ad0fef45 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:22:03 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d25eef40-5c34-4919-a7f4-bc919a61b22a" returned: 0 in 0.424s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efc2b5b-75d9-4ab9-a8a5-f6b91546ca55]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:03 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Volume volume-5f06e285-d2eb-4ee8-acec-e25124614141 (5f06e285-d2eb-4ee8-acec-e25124614141): created successfully Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a34efa-c89c-4c4f-8559-673b3ba30162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Flow 'volume_create_manager' (a4c88b6a-b9bb-4e64-9dbe-f38ff837e298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Lock "cinder-quobyte-d25eef40-5c34-4919-a7f4-bc919a61b22a" released by "delete_volume" :: held 1.236s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:03 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-962a7310-f185-4d5a-8962-063720d5c9cf tempest-AttachVolumeNegativeTest-3299601 None] Created volume successfully. Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Created reservations ['2e0ee998-67b4-49c0-b970-9329c4329348', '2a3cfd6b-dd21-43fb-83eb-69356ac1b7ab', '1ead4d5d-758d-4b6f-a8ca-870e2e21cb68', 'a652fc65-03ed-42fd-bd4c-f11fb34cd72e'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:22:03 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 Sep 17 07:22:03 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:03 devstack sudo[92460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:22:03 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:03 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45" returned: 0 in 0.498s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:03 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d 1G Sep 17 07:22:03 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:03 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.375s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:22:03 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Deleted volume successfully. Sep 17 07:22:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4fa65f08-91c3-4aa5-8099-1432988d5884 tempest-ServerActionsTestOtherA-1088735529 None] Lock "cinder-d25eef40-5c34-4919-a7f4-bc919a61b22a-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:04 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d 1G" returned: 0 in 0.663s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:04 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d Sep 17 07:22:04 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:22:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:22:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:22:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:04 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:04 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:22:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d" returned: 0 in 0.619s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:04 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d is being set with open permissions: ugo+rw: NotImplementedError Sep 17 07:22:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:04 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:05 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d Sep 17 07:22:05 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-577c04f2-07c5-4926-932b-fb9e6592ab88 req-ebcc3731-a348-4781-a0ef-ab982f2c5b83 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:05 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.562s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:22:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:22:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:22:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:22:05 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d" returned: 0 in 0.561s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:05 devstack sudo[92520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.info Sep 17 07:22:05 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:05 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.info" returned: 0 in 0.377s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:05 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 07:22:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:05 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.info Sep 17 07:22:05 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:06 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.info" returned: 0 in 0.321s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.273s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-577c04f2-07c5-4926-932b-fb9e6592ab88 req-ebcc3731-a348-4781-a0ef-ab982f2c5b83 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.995s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-577c04f2-07c5-4926-932b-fb9e6592ab88 req-ebcc3731-a348-4781-a0ef-ab982f2c5b83 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-577c04f2-07c5-4926-932b-fb9e6592ab88 req-ebcc3731-a348-4781-a0ef-ab982f2c5b83 tempest-AttachVolumeNegativeTest-3299601 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-5f06e285-d2eb-4ee8-acec-e25124614141', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd420a78b-54cd-480e-b1cb-e9f0dedf5ffa', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:22:06 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-095d169c-43b1-4ee9-90ce-fba39f5ba439 tempest-GroupSnapshotsTest-2103732326 None] group_snapshot d11f4277-1b4d-40d2-b3fe-0f726bce3672: created successfully Sep 17 07:22:06 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-577c04f2-07c5-4926-932b-fb9e6592ab88 req-ebcc3731-a348-4781-a0ef-ab982f2c5b83 tempest-AttachVolumeNegativeTest-3299601 None] attachment_update completed successfully. Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Flow 'volume_create_manager' (763fced5-eeba-425b-b13c-bbe692dc4a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e263badb-d644-41c6-a309-da0c64ffe402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e263badb-d644-41c6-a309-da0c64ffe402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-461781503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94812f01-b995-40a1-85a0-0fb5611532fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc68d568f3d4ac5bf4b89319fe3ee8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:22:07Z,use_quota=True,user_id='6191e3f80f014449b80078cfd836d8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74768852-b59d-496a-ace9-9b9c22335f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74768852-b59d-496a-ace9-9b9c22335f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4579b8-6935-48f6-835c-d3797089b035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4579b8-6935-48f6-835c-d3797089b035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94812f01-b995-40a1-85a0-0fb5611532fa', 'volume_name': 'volume-94812f01-b995-40a1-85a0-0fb5611532fa', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27007725-1dba-40fa-821e-87f72cfe641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27007725-1dba-40fa-821e-87f72cfe641e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87bcdf18-74b1-4d65-b309-fcb32df6ceeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:06 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Volume 94812f01-b995-40a1-85a0-0fb5611532fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94812f01-b995-40a1-85a0-0fb5611532fa', 'volume_size': 1} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-461781503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94812f01-b995-40a1-85a0-0fb5611532fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc68d568f3d4ac5bf4b89319fe3ee8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:22:07Z,use_quota=True,user_id='6191e3f80f014449b80078cfd836d8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Creating volume 94812f01-b995-40a1-85a0-0fb5611532fa {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:22:06 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:22:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:06 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa 1073741824 Sep 17 07:22:06 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:07 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa 1073741824" returned: 0 in 0.691s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:07 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa Sep 17 07:22:07 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:07 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa" returned: 0 in 0.347s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.317s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6" by "_create_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87bcdf18-74b1-4d65-b309-fcb32df6ceeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94812f01-b995-40a1-85a0-0fb5611532fa', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8f1521-2b72-4517-812d-5c91eef0e8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Creating volume bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6 from snapshot 7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d {{(pid=86029) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6" by "_copy_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:07 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Volume volume-94812f01-b995-40a1-85a0-0fb5611532fa (94812f01-b995-40a1-85a0-0fb5611532fa): created successfully Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8f1521-2b72-4517-812d-5c91eef0e8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Flow 'volume_create_manager' (763fced5-eeba-425b-b13c-bbe692dc4a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:22:08 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d341ad71-ecb1-4d0e-8b6d-1443492483fc tempest-VolumesActionsTest-802193143 None] Created volume successfully. Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] snapshot: 7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d, volume: bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6, {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79ef249-d8f5-4df4-ad8d-dec368c1fde1]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:08 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d Sep 17 07:22:08 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:08 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d" returned: 0 in 0.372s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7027f81e-6884-4e47-b94c-89e2ad0fef45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac8ab36-1680-4efd-bd13-5698947cab8c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:08 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 Sep 17 07:22:08 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:08 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45" returned: 0 in 0.413s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] will copy from snapshot at /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Creating direct copy from snapshot {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG cinder.utils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Path /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6 not found in is_blk_device check {{(pid=86029) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 07:22:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:08 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6 Sep 17 07:22:08 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:17 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=32,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:22:18 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=35,cinder:UPDATE=31,cinder:DELETE=4,cinder:INSERT=4 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:22:18 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6" returned: 0 in 10.101s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:18 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45, size 1024.00 MB, duration 10.10 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:22:18 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Converted 1024.00 MB image at 101.36 MB/s Sep 17 07:22:18 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 07:22:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:19 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6 Sep 17 07:22:19 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:19 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6" returned: 0 in 0.301s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6" released by "_copy_volume_from_snapshot" :: held 11.294s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6" released by "_create_volume_from_snapshot" :: held 11.407s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.448s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:19 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1f64ebf4-7fdf-4017-964d-7ec2b17fbf1a tempest-GroupSnapshotsTest-2103732326 None] Create group from source-snapshot-d11f4277-1b4d-40d2-b3fe-0f726bce3672 completed successfully. Sep 17 07:22:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6" acquired by "delete_volume" :: waited 0.037s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:20 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5178b8-c752-4a8c-81ae-56218542c366]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:20 devstack sudo[93021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6 Sep 17 07:22:20 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:21 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6" returned: 0 in 0.509s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:21 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6 Sep 17 07:22:21 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:21 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6" returned: 0 in 0.321s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-bd3f1eb7-f0d6-4a80-a3a7-7c546ed719d6" released by "delete_volume" :: held 0.906s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:21 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Created reservations ['7709556d-d0d3-4abd-b8b6-b4e24353378d'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:22:21 devstack cinder-volume[86029]: WARNING cinder.quota [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-374631943 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-374631943, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:22:21 devstack cinder-volume[86029]: WARNING cinder.quota [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-374631943 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-374631943, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:22:21 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Created reservations ['631f326f-67b2-4253-b1a4-7765f13b42ff', '6846f776-8b40-4e67-9ccf-b94b028de3f9', 'e61287b8-1fed-40fe-8a59-607965f9661a', '227a5014-c4a8-42f5-9d51-a18a3c52d4b1'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:22:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:22:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:22:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:21 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:22:21 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:22 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.284s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:22 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:22:22 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3869180e-ea6f-4b8c-9cfb-b8f94dfacf62 tempest-GroupSnapshotsTest-2103732326 None] Delete group completed successfully. Sep 17 07:22:23 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] group_snapshot d11f4277-1b4d-40d2-b3fe-0f726bce3672: deleting Sep 17 07:22:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] group_snapshot d11f4277-1b4d-40d2-b3fe-0f726bce3672: deleting {{(pid=86029) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 07:22:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-7027f81e-6884-4e47-b94c-89e2ad0fef45" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-7027f81e-6884-4e47-b94c-89e2ad0fef45" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] Deleting offline snapshot 7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d of volume 7027f81e-6884-4e47-b94c-89e2ad0fef45 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:22:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] snapshot_file for this snap is: volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:22:23 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4868c865-bdee-4d26-a0dc-020234e2b540]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:23 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d Sep 17 07:22:23 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:24 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d" returned: 0 in 0.848s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7027f81e-6884-4e47-b94c-89e2ad0fef45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:22:24 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[41679312-e14e-451d-9753-eede1e99c189]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:24 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 Sep 17 07:22:24 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:25 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45" returned: 0 in 1.138s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:25 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d Sep 17 07:22:25 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:26 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d" returned: 0 in 1.054s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:26 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d Sep 17 07:22:26 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:27 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d9975272-d547-473a-9f43-19eebb594090 tempest-VolumesActionsTest-802193143 None] Acquiring lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa" by "attach_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45.7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d" returned: 0 in 0.563s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d9975272-d547-473a-9f43-19eebb594090 tempest-VolumesActionsTest-802193143 None] Lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa" acquired by "attach_volume" :: waited 0.091s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-7e73cf0d-fb7e-4f4b-b7f7-6ed49ad54d0d" released by "_delete_snapshot" :: held 3.824s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-7027f81e-6884-4e47-b94c-89e2ad0fef45" released by "delete_snapshot" :: held 3.929s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:27 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d9975272-d547-473a-9f43-19eebb594090 tempest-VolumesActionsTest-802193143 None] Attaching volume 94812f01-b995-40a1-85a0-0fb5611532fa to instance 173184c4-2f05-4a58-92f9-669d33702b22 at mountpoint /dev/vdb on host None. Sep 17 07:22:27 devstack cinder-volume[86029]: WARNING cinder.quota [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-374631943 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-374631943, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:22:27 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d9975272-d547-473a-9f43-19eebb594090 tempest-VolumesActionsTest-802193143 None] Attach volume completed successfully. Sep 17 07:22:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d9975272-d547-473a-9f43-19eebb594090 tempest-VolumesActionsTest-802193143 None] Lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa" released by "attach_volume" :: held 0.227s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:27 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] Created reservations ['4e4d60b2-a406-451b-aa40-05a8752b1831', '2e09291a-d11c-4b71-85cc-7feeb1e5a09b', '40ffe2eb-9479-4942-b1cf-498441ac5839', '2bc84d8d-6357-4013-a43b-afeaf38f2ecb'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:22:27 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-dc0b7bd6-928a-498f-b1cc-305174a5b4a7 tempest-GroupSnapshotsTest-2103732326 None] group_snapshot d11f4277-1b4d-40d2-b3fe-0f726bce3672: deleted successfully Sep 17 07:22:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1b344682-dee2-4c23-a189-e2402ae032a3 tempest-VolumesActionsTest-802193143 None] Acquiring lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa-detach_volume" by "detach_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1b344682-dee2-4c23-a189-e2402ae032a3 tempest-VolumesActionsTest-802193143 None] Lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:27 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1b344682-dee2-4c23-a189-e2402ae032a3 tempest-VolumesActionsTest-802193143 None] Detaching volume 94812f01-b995-40a1-85a0-0fb5611532fa from instance 173184c4-2f05-4a58-92f9-669d33702b22. Sep 17 07:22:27 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1b344682-dee2-4c23-a189-e2402ae032a3 tempest-VolumesActionsTest-802193143 None] Detach volume completed successfully. Sep 17 07:22:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1b344682-dee2-4c23-a189-e2402ae032a3 tempest-VolumesActionsTest-802193143 None] Lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-7027f81e-6884-4e47-b94c-89e2ad0fef45" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-7027f81e-6884-4e47-b94c-89e2ad0fef45" acquired by "delete_volume" :: waited 0.093s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:28 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c318d59f-b0ed-4fc0-b1b8-dad5447dde2a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:29 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 Sep 17 07:22:29 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:30 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45" returned: 0 in 1.068s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:30 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45 Sep 17 07:22:30 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:30 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7027f81e-6884-4e47-b94c-89e2ad0fef45" returned: 0 in 0.637s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-7027f81e-6884-4e47-b94c-89e2ad0fef45" released by "delete_volume" :: held 1.937s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:30 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Created reservations ['29017035-5470-4bd9-af3f-af0c9744bfb2'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:22:31 devstack cinder-volume[86029]: WARNING cinder.db.api [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-374631943'] Sep 17 07:22:31 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Created reservations ['b48bef08-6112-4106-9d83-92749239efc9', '62b425c5-5fbe-4787-9004-7d54def80b75', '34e6c58b-204c-4fa5-9355-bc6c18006240', 'd3c2ad09-28ca-4fa9-bf38-6c05711ee2eb'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:22:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:22:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:22:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:31 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:22:31 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:31 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.417s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:31 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:22:31 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-af11d665-d3b1-440c-ab02-fd2bd3b5d55d tempest-GroupSnapshotsTest-2103732326 None] Delete group completed successfully. Sep 17 07:22:33 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0cf56fa2-f4b9-4cf2-85fc-3d388ebc0c13 tempest-GroupSnapshotsTest-2103732326 None] Group tempest-GroupSnapshotsTest-Group-308859781: creating Sep 17 07:22:33 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0cf56fa2-f4b9-4cf2-85fc-3d388ebc0c13 tempest-GroupSnapshotsTest-2103732326 None] Group tempest-GroupSnapshotsTest-Group-308859781: created successfully Sep 17 07:22:33 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0cf56fa2-f4b9-4cf2-85fc-3d388ebc0c13 tempest-GroupSnapshotsTest-2103732326 None] Create group completed successfully. Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Flow 'volume_create_manager' (276deedd-ead5-4b95-bcb4-a9c35e99c136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b4efaf-1a1d-4835-9bc9-7d4103f55dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b4efaf-1a1d-4835-9bc9-7d4103f55dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1747374830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e69313d-c87b-4744-8cc5-fbd580034393,host='devstack@QuobyteHD#QuobyteHD',id=415de9e0-01c3-4068-9817-b4f02a506e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='997d007bd7fb4bb485c52bb59bc9217a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:22:35Z,use_quota=True,user_id='fc89eb0410514be5ac9dfa9fe4fbea05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9112c332-0af6-49eb-8368-a50516d1a15e),volume_type_id=9112c332-0af6-49eb-8368-a50516d1a15e)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba353f8-e7ba-40bc-b1b1-e4e6f13a5bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba353f8-e7ba-40bc-b1b1-e4e6f13a5bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff69f43c-5552-487e-bafb-b6199f93b3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff69f43c-5552-487e-bafb-b6199f93b3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '415de9e0-01c3-4068-9817-b4f02a506e6c', 'volume_name': 'volume-415de9e0-01c3-4068-9817-b4f02a506e6c', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9b2397-198a-4efa-a5f8-353b36874aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9b2397-198a-4efa-a5f8-353b36874aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0377fe2-8bdf-4859-a2af-3e44989561ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:35 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Volume 415de9e0-01c3-4068-9817-b4f02a506e6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-415de9e0-01c3-4068-9817-b4f02a506e6c', 'volume_size': 1} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e69313d-c87b-4744-8cc5-fbd580034393,created_at=2026-09-17T05:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1747374830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e69313d-c87b-4744-8cc5-fbd580034393,host='devstack@QuobyteHD#QuobyteHD',id=415de9e0-01c3-4068-9817-b4f02a506e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='997d007bd7fb4bb485c52bb59bc9217a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:22:35Z,use_quota=True,user_id='fc89eb0410514be5ac9dfa9fe4fbea05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9112c332-0af6-49eb-8368-a50516d1a15e),volume_type_id=9112c332-0af6-49eb-8368-a50516d1a15e)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Creating volume 415de9e0-01c3-4068-9817-b4f02a506e6c {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:22:35 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:22:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:35 devstack sudo[93251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c 1073741824 Sep 17 07:22:35 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:36 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c 1073741824" returned: 0 in 0.802s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:36 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c Sep 17 07:22:36 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:36 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c" returned: 0 in 0.549s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:22:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0377fe2-8bdf-4859-a2af-3e44989561ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-415de9e0-01c3-4068-9817-b4f02a506e6c', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4d9463-4e20-4150-ab2c-8b2190824eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:36 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Volume volume-415de9e0-01c3-4068-9817-b4f02a506e6c (415de9e0-01c3-4068-9817-b4f02a506e6c): created successfully Sep 17 07:22:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4d9463-4e20-4150-ab2c-8b2190824eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Flow 'volume_create_manager' (276deedd-ead5-4b95-bcb4-a9c35e99c136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:22:36 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2d6e4543-dec3-46a3-86ed-f84f5e6375f0 tempest-GroupSnapshotsTest-2103732326 None] Created volume successfully. Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Flow 'volume_create_manager' (8043a8a0-eb7f-4047-b3f1-9b13bf146f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5f14ba-d91f-4228-9244-f71ff2db5e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5f14ba-d91f-4228-9244-f71ff2db5e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-640556537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e69313d-c87b-4744-8cc5-fbd580034393,host='devstack@QuobyteHD#QuobyteHD',id=a6f555bb-bcdc-405c-8cc7-4db664353abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='997d007bd7fb4bb485c52bb59bc9217a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:22:39Z,use_quota=True,user_id='fc89eb0410514be5ac9dfa9fe4fbea05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9112c332-0af6-49eb-8368-a50516d1a15e),volume_type_id=9112c332-0af6-49eb-8368-a50516d1a15e)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0813f0be-2c1e-4638-852e-f44c99dbcc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0813f0be-2c1e-4638-852e-f44c99dbcc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8454a950-4355-43ae-85b6-f4a979ecad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8454a950-4355-43ae-85b6-f4a979ecad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f555bb-bcdc-405c-8cc7-4db664353abf', 'volume_name': 'volume-a6f555bb-bcdc-405c-8cc7-4db664353abf', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c05510b-71b2-4d19-a048-e6f311f11874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c05510b-71b2-4d19-a048-e6f311f11874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195eaa9a-126c-4bc0-9720-aee95ada33f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:39 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Volume a6f555bb-bcdc-405c-8cc7-4db664353abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f555bb-bcdc-405c-8cc7-4db664353abf', 'volume_size': 1} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e69313d-c87b-4744-8cc5-fbd580034393,created_at=2026-09-17T05:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-640556537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e69313d-c87b-4744-8cc5-fbd580034393,host='devstack@QuobyteHD#QuobyteHD',id=a6f555bb-bcdc-405c-8cc7-4db664353abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='997d007bd7fb4bb485c52bb59bc9217a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:22:39Z,use_quota=True,user_id='fc89eb0410514be5ac9dfa9fe4fbea05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9112c332-0af6-49eb-8368-a50516d1a15e),volume_type_id=9112c332-0af6-49eb-8368-a50516d1a15e)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Creating volume a6f555bb-bcdc-405c-8cc7-4db664353abf {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:22:39 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:22:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:39 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf 1073741824 Sep 17 07:22:39 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:40 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf 1073741824" returned: 0 in 0.885s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:40 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf Sep 17 07:22:40 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:40 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf" returned: 0 in 0.407s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:22:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195eaa9a-126c-4bc0-9720-aee95ada33f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f555bb-bcdc-405c-8cc7-4db664353abf', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdf6107-8643-4b69-a183-e0f23775f445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:22:40 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Volume volume-a6f555bb-bcdc-405c-8cc7-4db664353abf (a6f555bb-bcdc-405c-8cc7-4db664353abf): created successfully Sep 17 07:22:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdf6107-8643-4b69-a183-e0f23775f445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:22:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Flow 'volume_create_manager' (8043a8a0-eb7f-4047-b3f1-9b13bf146f53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:22:40 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e3443f5b-1c89-4d96-af6b-079e4cbc0394 tempest-GroupSnapshotsTest-2103732326 None] Created volume successfully. Sep 17 07:22:41 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d8797c1e-81ba-4270-a731-3e1d0aefa712 tempest-GroupSnapshotsTest-2103732326 None] Update group completed successfully. Sep 17 07:22:43 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-43f6446b-984c-4852-ace5-31e2ece70a6f tempest-GroupSnapshotsTest-2103732326 None] Update group completed successfully. Sep 17 07:22:44 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2775289e-7a82-4ce2-8a83-106153546604 tempest-GroupSnapshotsTest-2103732326 None] Update group completed successfully. Sep 17 07:22:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-71583550-2757-4eaf-856c-11c21aa0831f tempest-VolumesActionsTest-802193143 None] Acquiring lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa" by "attach_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-71583550-2757-4eaf-856c-11c21aa0831f tempest-VolumesActionsTest-802193143 None] Lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa" acquired by "attach_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:44 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-71583550-2757-4eaf-856c-11c21aa0831f tempest-VolumesActionsTest-802193143 None] Attaching volume 94812f01-b995-40a1-85a0-0fb5611532fa to instance 1f0dbe30-9b14-472e-993f-fe28efb8bf82 at mountpoint /dev/vdb on host None. Sep 17 07:22:44 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-71583550-2757-4eaf-856c-11c21aa0831f tempest-VolumesActionsTest-802193143 None] Attach volume completed successfully. Sep 17 07:22:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-71583550-2757-4eaf-856c-11c21aa0831f tempest-VolumesActionsTest-802193143 None] Lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa" released by "attach_volume" :: held 0.099s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-18c41ccc-2c51-49f3-9e80-e584d25a0cb2 tempest-VolumesActionsTest-802193143 None] Acquiring lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa-detach_volume" by "detach_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-18c41ccc-2c51-49f3-9e80-e584d25a0cb2 tempest-VolumesActionsTest-802193143 None] Lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:45 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-18c41ccc-2c51-49f3-9e80-e584d25a0cb2 tempest-VolumesActionsTest-802193143 None] Detaching volume 94812f01-b995-40a1-85a0-0fb5611532fa from instance 1f0dbe30-9b14-472e-993f-fe28efb8bf82. Sep 17 07:22:45 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-18c41ccc-2c51-49f3-9e80-e584d25a0cb2 tempest-VolumesActionsTest-802193143 None] Detach volume completed successfully. Sep 17 07:22:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-18c41ccc-2c51-49f3-9e80-e584d25a0cb2 tempest-VolumesActionsTest-802193143 None] Lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:45 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3205f156-9112-4216-bae4-ab8c83ce00fc tempest-GroupSnapshotsTest-2103732326 None] Update group completed successfully. Sep 17 07:22:47 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] GroupSnapshot eeb7840b-ff46-4393-8ce5-3edd586efeb4: creating. Sep 17 07:22:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Group snapshot eeb7840b-ff46-4393-8ce5-3edd586efeb4: creating. {{(pid=86029) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 07:22:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Creating offline snapshot 7ee9e914-0eec-4422-ac93-582ea2043306 of volume 415de9e0-01c3-4068-9817-b4f02a506e6c {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:22:47 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2e252b-1d84-43e4-87f0-5b6449d4fddc]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:47 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c Sep 17 07:22:47 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:48 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c" returned: 0 in 0.557s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:48 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 1G Sep 17 07:22:48 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:48 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 1G" returned: 0 in 0.613s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-415de9e0-01c3-4068-9817-b4f02a506e6c -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:48 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-415de9e0-01c3-4068-9817-b4f02a506e6c -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 Sep 17 07:22:48 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:49 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-415de9e0-01c3-4068-9817-b4f02a506e6c -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306" returned: 0 in 0.486s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:49 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 07:22:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:49 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 Sep 17 07:22:49 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:49 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306" returned: 0 in 0.353s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:49 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.info Sep 17 07:22:49 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:50 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.info" returned: 0 in 0.328s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:50 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 07:22:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:50 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.info Sep 17 07:22:50 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:50 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.info" returned: 0 in 0.332s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.811s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Creating offline snapshot b3275a59-c0c6-47b7-a3c7-4c285a62bfbb of volume a6f555bb-bcdc-405c-8cc7-4db664353abf {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:22:50 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[98aedaeb-fa41-4800-b4d6-42e17a0c1b11]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:50 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf Sep 17 07:22:50 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:22:51 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf" returned: 0 in 0.877s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:51 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb 1G Sep 17 07:22:51 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:51 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb 1G" returned: 0 in 0.663s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f555bb-bcdc-405c-8cc7-4db664353abf -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:52 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f555bb-bcdc-405c-8cc7-4db664353abf -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb Sep 17 07:22:52 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:52 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f555bb-bcdc-405c-8cc7-4db664353abf -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb" returned: 0 in 0.356s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:52 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb is being set with open permissions: ugo+rw: NotImplementedError Sep 17 07:22:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:52 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb Sep 17 07:22:52 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:52 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb" returned: 0 in 0.297s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:52 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.info Sep 17 07:22:52 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:52 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.info" returned: 0 in 0.266s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:52 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 07:22:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:52 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.info Sep 17 07:22:52 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:53 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.info" returned: 0 in 0.257s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:22:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.323s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:22:53 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ab67b3-ee46-40ce-9451-9c9621786336]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:53 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa Sep 17 07:22:53 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:53 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-30119a9a-fccf-4008-bbab-3919ff7dcd0b tempest-GroupSnapshotsTest-2103732326 None] group_snapshot eeb7840b-ff46-4393-8ce5-3edd586efeb4: created successfully Sep 17 07:22:53 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa" returned: 0 in 0.415s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:53 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24e129c-abdb-445c-91ee-226d75ca7f68]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:53 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa Sep 17 07:22:53 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:54 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:54 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] group_snapshot eeb7840b-ff46-4393-8ce5-3edd586efeb4: deleting Sep 17 07:22:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa" returned: 0 in 0.791s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.d744fdee-f02c-4e1d-bd82-bdd93f754269irc3r8mw.img {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:54 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.d744fdee-f02c-4e1d-bd82-bdd93f754269irc3r8mw.img Sep 17 07:22:54 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] group_snapshot eeb7840b-ff46-4393-8ce5-3edd586efeb4: deleting {{(pid=86029) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 07:22:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-415de9e0-01c3-4068-9817-b4f02a506e6c" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-415de9e0-01c3-4068-9817-b4f02a506e6c" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-7ee9e914-0eec-4422-ac93-582ea2043306" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-7ee9e914-0eec-4422-ac93-582ea2043306" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Deleting offline snapshot 7ee9e914-0eec-4422-ac93-582ea2043306 of volume 415de9e0-01c3-4068-9817-b4f02a506e6c {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:22:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] snapshot_file for this snap is: volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:22:54 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a129c15-ed98-4792-969d-887ecc727570]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:55 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 Sep 17 07:22:55 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:56 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306" returned: 0 in 1.163s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-415de9e0-01c3-4068-9817-b4f02a506e6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:22:56 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f67b3c3-6c12-4311-bbd9-6b83ea5e9378]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:56 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c Sep 17 07:22:56 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:57 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c" returned: 0 in 1.364s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:57 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 Sep 17 07:22:57 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:58 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306" returned: 0 in 1.183s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:22:58 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306 Sep 17 07:22:58 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:22:59 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Sep 17 07:22:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c.7ee9e914-0eec-4422-ac93-582ea2043306" returned: 0 in 0.712s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:22:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-7ee9e914-0eec-4422-ac93-582ea2043306" released by "_delete_snapshot" :: held 4.742s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-415de9e0-01c3-4068-9817-b4f02a506e6c" released by "delete_snapshot" :: held 4.832s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:22:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-a6f555bb-bcdc-405c-8cc7-4db664353abf" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-a6f555bb-bcdc-405c-8cc7-4db664353abf" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-b3275a59-c0c6-47b7-a3c7-4c285a62bfbb" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:22:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-b3275a59-c0c6-47b7-a3c7-4c285a62bfbb" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:22:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Deleting offline snapshot b3275a59-c0c6-47b7-a3c7-4c285a62bfbb of volume a6f555bb-bcdc-405c-8cc7-4db664353abf {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:22:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] snapshot_file for this snap is: volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:22:59 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1b66b1-83f0-4e21-bc51-17d919e32169]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:22:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:00 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb Sep 17 07:23:00 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:00 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb" returned: 0 in 1.006s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f555bb-bcdc-405c-8cc7-4db664353abf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:23:00 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74e06f9-514c-42cd-8cad-1b4560e8ff1c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:23:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:01 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf Sep 17 07:23:01 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:02 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf" returned: 0 in 1.226s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:02 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb Sep 17 07:23:02 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:03 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb" returned: 0 in 1.168s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:03 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb Sep 17 07:23:03 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:03 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf.b3275a59-c0c6-47b7-a3c7-4c285a62bfbb" returned: 0 in 0.552s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-b3275a59-c0c6-47b7-a3c7-4c285a62bfbb" released by "_delete_snapshot" :: held 4.316s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:23:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-a6f555bb-bcdc-405c-8cc7-4db664353abf" released by "delete_snapshot" :: held 4.373s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:23:04 devstack cinder-volume[86029]: WARNING cinder.quota [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-621985531 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-621985531, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:23:04 devstack cinder-volume[86029]: WARNING cinder.quota [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-621985531 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-621985531, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:23:04 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Created reservations ['05593817-e26e-43c4-8f88-013f23991f5d', '359e26ba-aa47-44f9-b752-0df12e265f60', '995ea0f8-06f8-4e3f-be43-ef30d63d3461', '1f07822f-ad37-4707-a0e7-d12774390edb'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:23:04 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] Created reservations ['a191baa3-9332-49d8-8171-8ac288819693', '09d3a900-5665-47b7-abdf-a5bc757768e8', 'fd9494f9-e941-41a2-a825-f8f2c62d77c4', 'e90031ae-720f-49c6-966a-a81d3fb42cb4'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:23:04 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-496a00eb-60e6-4065-bff6-82c41127531a tempest-GroupSnapshotsTest-2103732326 None] group_snapshot eeb7840b-ff46-4393-8ce5-3edd586efeb4: deleted successfully Sep 17 07:23:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:23:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:23:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:23:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:04 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:23:04 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:05 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-3cbd0e3a-ee80-4084-9a39-efc2f3c643dc req-126ae124-5454-4e7f-9140-8c9b262f9620 tempest-AttachVolumeNegativeTest-3299601 None] Terminate volume connection completed successfully. Sep 17 07:23:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3cbd0e3a-ee80-4084-9a39-efc2f3c643dc req-126ae124-5454-4e7f-9140-8c9b262f9620 tempest-AttachVolumeNegativeTest-3299601 None] Deleting attachment d420a78b-54cd-480e-b1cb-e9f0dedf5ffa. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:23:05 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.649s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:23:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:23:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:23:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:23:05 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.d744fdee-f02c-4e1d-bd82-bdd93f754269irc3r8mw.img" returned: 0 in 11.113s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:05 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[822aaa41-6d55-4150-9d73-c77c55199d31]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:23:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:05 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa Sep 17 07:23:05 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-415de9e0-01c3-4068-9817-b4f02a506e6c" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:23:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-415de9e0-01c3-4068-9817-b4f02a506e6c" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:23:05 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b361e4-223b-49a4-b21f-5906c375d96e]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:23:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:06 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c Sep 17 07:23:06 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:06 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa" returned: 0 in 0.656s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:06 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa, size 1024.00 MB, duration 11.11 sec, destination /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.d744fdee-f02c-4e1d-bd82-bdd93f754269irc3r8mw.img {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:23:06 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] Converted 1024.00 MB image at 92.14 MB/s Sep 17 07:23:06 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] d744fdee-f02c-4e1d-bd82-bdd93f754269 was raw, no need to convert to raw {{(pid=86029) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 17 07:23:06 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c" returned: 0 in 0.428s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:06 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c Sep 17 07:23:06 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:06 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-415de9e0-01c3-4068-9817-b4f02a506e6c" returned: 0 in 0.389s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-415de9e0-01c3-4068-9817-b4f02a506e6c" released by "delete_volume" :: held 0.902s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:23:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-a6f555bb-bcdc-405c-8cc7-4db664353abf" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:23:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-a6f555bb-bcdc-405c-8cc7-4db664353abf" acquired by "delete_volume" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:23:06 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd0f0b9-feaa-453b-9e06-3de9212c90f7]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:23:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:07 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf Sep 17 07:23:07 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:07 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf" returned: 0 in 0.523s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:07 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf Sep 17 07:23:07 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:07 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a6f555bb-bcdc-405c-8cc7-4db664353abf" returned: 0 in 0.341s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-a6f555bb-bcdc-405c-8cc7-4db664353abf" released by "delete_volume" :: held 0.956s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:23:07 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Created reservations ['68bf8a4e-6e3d-47f0-862d-cf64ee05220b'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:23:07 devstack cinder-volume[86029]: WARNING cinder.quota [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-621985531 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-621985531, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:23:07 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Created reservations ['a70f34bc-a1be-45af-a926-262f8b7dee83', '7fa759aa-3af3-4c61-a7ac-7478dbc8892b', '223a1294-6174-4ec2-9dd3-02ec69f0fdca', '09f0f4fe-ab53-423b-8d33-bc8c7cf8e714'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:23:08 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Created reservations ['3a05cc02-bb79-4fd9-a302-2e93fabcd97b', '4d719346-76d8-4714-acc6-7aefb140160e', '8fde95f8-5ee4-4208-9207-d406a0dce7a0', '02abe031-1080-4547-9932-3462772ab10b'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:23:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:23:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:23:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:08 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:23:08 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:08 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.306s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:08 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:23:08 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-f5163a6d-6dc3-4c58-b6e2-b126794ebd4b tempest-GroupSnapshotsTest-2103732326 None] Delete group completed successfully. Sep 17 07:23:08 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1e4fe605-b78f-4097-ae00-37d072429e44 tempest-GroupSnapshotsTest-2103732326 None] Group tempest-GroupSnapshotsTest-Group-1679011122: creating Sep 17 07:23:09 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1e4fe605-b78f-4097-ae00-37d072429e44 tempest-GroupSnapshotsTest-2103732326 None] Group tempest-GroupSnapshotsTest-Group-1679011122: created successfully Sep 17 07:23:09 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1e4fe605-b78f-4097-ae00-37d072429e44 tempest-GroupSnapshotsTest-2103732326 None] Create group completed successfully. Sep 17 07:23:10 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:23:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Flow 'volume_create_manager' (def5b904-7b95-4e14-9a1b-22cf14056b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:23:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6d62b8-ab5a-4445-9170-a1ad8ffe72c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6d62b8-ab5a-4445-9170-a1ad8ffe72c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-956365132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cb31b62-29e4-4880-8bea-da02d09b6519,host='devstack@QuobyteHD#QuobyteHD',id=43b2c28f-5c70-4d92-859a-f2ed3f691e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='997d007bd7fb4bb485c52bb59bc9217a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:23:11Z,use_quota=True,user_id='fc89eb0410514be5ac9dfa9fe4fbea05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae0d550-238e-4893-9de7-d2a99db9df5a),volume_type_id=6ae0d550-238e-4893-9de7-d2a99db9df5a)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4423920-18da-460b-bfbd-c0dcb3be0f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4423920-18da-460b-bfbd-c0dcb3be0f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7af46b9-9787-4070-b9f3-0f9fcfe98aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7af46b9-9787-4070-b9f3-0f9fcfe98aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b2c28f-5c70-4d92-859a-f2ed3f691e6c', 'volume_name': 'volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b31b66-4086-4cfc-98d8-0677cc916937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b31b66-4086-4cfc-98d8-0677cc916937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4191a04-ae8c-41e2-8a22-815a992f78d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:10 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Volume 43b2c28f-5c70-4d92-859a-f2ed3f691e6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c', 'volume_size': 1} Sep 17 07:23:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:20 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=82,cinder:INSERT=16,cinder:UPDATE=86,cinder:DELETE=1 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:23:20 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=102,cinder:UPDATE=81,cinder:INSERT=24,cinder:DELETE=1 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:23:20 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:23:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Flow 'volume_create_manager' (8e85da45-988c-40a6-9f43-f3e531867243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:23:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7de5808-9a67-4dcd-be9b-3223dab9752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7de5808-9a67-4dcd-be9b-3223dab9752f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-374450308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b12e2b-3744-409a-9dc9-3b658259b6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='318b790836dc4c76b1ef46741593cc63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:23:20Z,use_quota=True,user_id='5c1fb15bca79409db1015204b8a03ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4b29b6-7ffa-4ef1-a6dd-f1f6e3245edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4b29b6-7ffa-4ef1-a6dd-f1f6e3245edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057bc287-edf8-4717-8452-5f9e07c18dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057bc287-edf8-4717-8452-5f9e07c18dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b12e2b-3744-409a-9dc9-3b658259b6c8', 'volume_name': 'volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b237e5b-acd7-4666-a2a5-97539f9002dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b237e5b-acd7-4666-a2a5-97539f9002dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4746ef-7f9e-4a71-876a-f3386cc8132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:20 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Volume a8b12e2b-3744-409a-9dc9-3b658259b6c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8', 'volume_size': 1} Sep 17 07:23:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:30 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=1 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.911s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] Uploaded volume to glance image-id: d744fdee-f02c-4e1d-bd82-bdd93f754269. {{(pid=86029) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.183s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5cb31b62-29e4-4880-8bea-da02d09b6519,created_at=2026-09-17T05:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-956365132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cb31b62-29e4-4880-8bea-da02d09b6519,host='devstack@QuobyteHD#QuobyteHD',id=43b2c28f-5c70-4d92-859a-f2ed3f691e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='997d007bd7fb4bb485c52bb59bc9217a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:23:11Z,use_quota=True,user_id='fc89eb0410514be5ac9dfa9fe4fbea05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae0d550-238e-4893-9de7-d2a99db9df5a),volume_type_id=6ae0d550-238e-4893-9de7-d2a99db9df5a)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Creating volume 43b2c28f-5c70-4d92-859a-f2ed3f691e6c {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:23:31 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:31 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-995f1164-d830-4d39-8571-e0196b8f199c tempest-VolumesActionsTest-802193143 None] Copy volume to image completed successfully. Sep 17 07:23:31 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c 1073741824 Sep 17 07:23:31 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:31 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c 1073741824" returned: 0 in 0.488s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:31 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c Sep 17 07:23:31 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:31 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c" returned: 0 in 0.287s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.589s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-374450308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b12e2b-3744-409a-9dc9-3b658259b6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='318b790836dc4c76b1ef46741593cc63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:23:20Z,use_quota=True,user_id='5c1fb15bca79409db1015204b8a03ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Creating volume a8b12e2b-3744-409a-9dc9-3b658259b6c8 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:23:31 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:23:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4191a04-ae8c-41e2-8a22-815a992f78d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5be0a4f-e2fc-4b26-bb98-0cc5c701f77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:32 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Volume volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c (43b2c28f-5c70-4d92-859a-f2ed3f691e6c): created successfully Sep 17 07:23:32 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8 1073741824 Sep 17 07:23:32 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5be0a4f-e2fc-4b26-bb98-0cc5c701f77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Flow 'volume_create_manager' (def5b904-7b95-4e14-9a1b-22cf14056b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:23:32 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b9da3d1b-784b-476f-b149-c659e1bbd3c0 tempest-GroupSnapshotsTest-2103732326 None] Created volume successfully. Sep 17 07:23:32 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] GroupSnapshot 124f470e-df59-44ee-8edd-b0dac3a05f17: creating. Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] Group snapshot 124f470e-df59-44ee-8edd-b0dac3a05f17: creating. {{(pid=86029) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:32 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8 1073741824" returned: 0 in 0.679s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:32 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8 Sep 17 07:23:32 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:32 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8" returned: 0 in 0.260s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.333s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4746ef-7f9e-4a71-876a-f3386cc8132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63c0578-c294-4899-b9ea-fba3e564dd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] Creating offline snapshot 39f6252b-1be5-451c-9f50-170a008382ae of volume 43b2c28f-5c70-4d92-859a-f2ed3f691e6c {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:23:33 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Volume volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8 (a8b12e2b-3744-409a-9dc9-3b658259b6c8): created successfully Sep 17 07:23:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63c0578-c294-4899-b9ea-fba3e564dd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Flow 'volume_create_manager' (8e85da45-988c-40a6-9f43-f3e531867243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:23:33 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadd00d9-a3ff-494f-a3d5-3052e9613a6c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:23:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:33 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-bb6eb2ee-9534-47a7-ba2e-baf4a13e5b71 tempest-AttachVolumeTestJSON-1860146425 None] Created volume successfully. Sep 17 07:23:33 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c Sep 17 07:23:33 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:33 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c" returned: 0 in 0.397s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:33 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae 1G Sep 17 07:23:33 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-ba1c2708-e9a5-4438-942f-ca595dbada2d req-fae28c19-1050-4672-8f93-1c7e77c08544 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:33 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae 1G" returned: 0 in 0.465s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:33 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae Sep 17 07:23:33 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:34 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae" returned: 0 in 0.297s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:34 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae is being set with open permissions: ugo+rw: NotImplementedError Sep 17 07:23:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:34 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae Sep 17 07:23:34 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:34 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae" returned: 0 in 0.246s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:34 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.info Sep 17 07:23:34 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:34 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.info" returned: 0 in 0.255s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:34 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 07:23:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:34 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.info Sep 17 07:23:34 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:34 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.info" returned: 0 in 0.244s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.231s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:34 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8c70be-c2b1-45f3-8f05-832fdb3b2ad8]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:23:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:35 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cf7a44ad-4527-4d80-9331-f15d2db26c46 tempest-GroupSnapshotsTest-2103732326 None] group_snapshot 124f470e-df59-44ee-8edd-b0dac3a05f17: created successfully Sep 17 07:23:35 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa Sep 17 07:23:35 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:35 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa" returned: 0 in 0.366s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:35 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e17d8f-b49e-4d65-82f7-c9f2b776201e]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:23:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:35 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa Sep 17 07:23:35 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:35 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa" returned: 0 in 0.361s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:35 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img Sep 17 07:23:35 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:35 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] group_snapshot 124f470e-df59-44ee-8edd-b0dac3a05f17: deleting Sep 17 07:23:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] group_snapshot 124f470e-df59-44ee-8edd-b0dac3a05f17: deleting {{(pid=86029) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 07:23:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-43b2c28f-5c70-4d92-859a-f2ed3f691e6c" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:23:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-43b2c28f-5c70-4d92-859a-f2ed3f691e6c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:23:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-39f6252b-1be5-451c-9f50-170a008382ae" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:23:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-39f6252b-1be5-451c-9f50-170a008382ae" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:23:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Deleting offline snapshot 39f6252b-1be5-451c-9f50-170a008382ae of volume 43b2c28f-5c70-4d92-859a-f2ed3f691e6c {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:23:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] snapshot_file for this snap is: volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:23:36 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5031ccc-55aa-41f3-840b-d83abc43fddc]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:23:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:36 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae Sep 17 07:23:36 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:36 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae" returned: 0 in 0.866s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:23:37 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac3698d-bcc4-412d-a687-a6319536cc93]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:23:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:37 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c Sep 17 07:23:37 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:37 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c" returned: 0 in 0.579s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:37 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae Sep 17 07:23:37 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:38 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae" returned: 0 in 0.756s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:38 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae Sep 17 07:23:38 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:38 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c.39f6252b-1be5-451c-9f50-170a008382ae" returned: 0 in 0.393s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-39f6252b-1be5-451c-9f50-170a008382ae" released by "_delete_snapshot" :: held 2.786s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:23:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-43b2c28f-5c70-4d92-859a-f2ed3f691e6c" released by "delete_snapshot" :: held 2.815s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:23:39 devstack cinder-volume[86029]: WARNING cinder.quota [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1064365933 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1064365933, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:23:39 devstack cinder-volume[86029]: WARNING cinder.quota [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1064365933 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1064365933, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:23:39 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] Created reservations ['380c5bf3-f2d3-41ca-8c6b-7ea081474939', '910297cf-7e8b-4e3f-ade5-c8729ee9b732', 'de6f5988-212a-44cf-9685-caec630f21e8', '9e6be088-d732-490c-9323-281f2a0ffde3'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:23:39 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8d7b41bc-64ab-41eb-9bce-fb19a2f94e65 tempest-GroupSnapshotsTest-2103732326 None] group_snapshot 124f470e-df59-44ee-8edd-b0dac3a05f17: deleted successfully Sep 17 07:23:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "cinder-quobyte-43b2c28f-5c70-4d92-859a-f2ed3f691e6c" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:23:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-43b2c28f-5c70-4d92-859a-f2ed3f691e6c" acquired by "delete_volume" :: waited 0.053s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:23:40 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eececc5-3e4b-492f-98ee-be8e35251e1e]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:23:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:40 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c Sep 17 07:23:40 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:40 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c" returned: 0 in 0.631s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:40 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c Sep 17 07:23:40 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:41 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-43b2c28f-5c70-4d92-859a-f2ed3f691e6c" returned: 0 in 0.546s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Lock "cinder-quobyte-43b2c28f-5c70-4d92-859a-f2ed3f691e6c" released by "delete_volume" :: held 1.382s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:23:41 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Created reservations ['7fa91093-f9f2-4830-a8f1-b51542e6dcb9'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:23:41 devstack cinder-volume[86029]: WARNING cinder.quota [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1064365933 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1064365933, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:23:41 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Created reservations ['9b8fd02e-a0f4-4494-a2c6-7e2f2a62a535', '61dc6f20-fefa-4480-9fa5-e8cf365d835b', 'a795ac3c-ddff-4cea-b870-e35e255d3d6e', 'bd5c978a-594b-461d-8b2d-c958d8d96a70'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:23:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:23:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:23:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:41 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:23:41 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:42 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.463s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:42 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:23:42 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-303f14c7-11b5-4c7d-aa4d-28305d554668 tempest-GroupSnapshotsTest-2103732326 None] Delete group completed successfully. Sep 17 07:23:42 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:23:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Flow 'volume_create_manager' (b23853eb-c4be-4482-9281-3b89a87d6454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:23:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0f1238-3fb1-435c-8b78-e3f7817d23a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0f1238-3fb1-435c-8b78-e3f7817d23a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2043610494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9ae0bc-94f8-469a-9224-7486937045d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23dd9b1144fa4fdaa98a7c07322f8108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:23:43Z,use_quota=True,user_id='294ceb58122942b39bec08ea3585625b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b0c2e0-78a1-4c6e-80d8-529a54691d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b0c2e0-78a1-4c6e-80d8-529a54691d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2e52dc-c8d5-49ee-a2f9-008622b60021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2e52dc-c8d5-49ee-a2f9-008622b60021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb9ae0bc-94f8-469a-9224-7486937045d9', 'volume_name': 'volume-fb9ae0bc-94f8-469a-9224-7486937045d9', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad174d0-17f9-4be3-b638-b2e3e00f9358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad174d0-17f9-4be3-b638-b2e3e00f9358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9cb9b38-c9af-4382-8fb3-7d8e950858d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:42 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Volume fb9ae0bc-94f8-469a-9224-7486937045d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb9ae0bc-94f8-469a-9224-7486937045d9', 'volume_size': 1} Sep 17 07:23:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:43 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img" returned: 0 in 7.523s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:43 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f926c7-adb6-4292-8076-c06e1332fe0c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:23:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:43 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa Sep 17 07:23:43 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:43 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa" returned: 0 in 0.553s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:43 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa, size 1024.00 MB, duration 7.52 sec, destination /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:23:43 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Converted 1024.00 MB image at 136.10 MB/s Sep 17 07:23:43 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] 6b14e2ae-16e3-4519-9c39-95c853e495c0 was raw, converting to qcow2 {{(pid=86029) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 17 07:23:43 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4703b8f-623f-42de-bcda-f717ac4f2ab7]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:23:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:43 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img Sep 17 07:23:43 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:44 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img" returned: 0 in 0.341s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:44 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img Sep 17 07:23:44 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:44 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img" returned: 1 in 0.336s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:23:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img /opt/stack/data/cinder/conversion/vol_upload_cnwhr17x {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:44 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img /opt/stack/data/cinder/conversion/vol_upload_cnwhr17x Sep 17 07:23:44 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:44 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img /opt/stack/data/cinder/conversion/vol_upload_cnwhr17x" returned: 0 in 0.313s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:44 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Image conversion details: src /opt/stack/data/cinder/conversion/94812f01-b995-40a1-85a0-0fb5611532fa.temp_image.6b14e2ae-16e3-4519-9c39-95c853e495c01ioqw9mn.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_cnwhr17x {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:23:44 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 17 07:23:44 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f73cd0-8b35-4ff2-b35c-399a830b72bc]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:23:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cnwhr17x {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:44 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cnwhr17x Sep 17 07:23:44 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:45 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cnwhr17x" returned: 0 in 0.351s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.729s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Uploaded volume to glance image-id: 6b14e2ae-16e3-4519-9c39-95c853e495c0. {{(pid=86029) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-ba1c2708-e9a5-4438-942f-ca595dbada2d req-fae28c19-1050-4672-8f93-1c7e77c08544 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.921s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-ba1c2708-e9a5-4438-942f-ca595dbada2d req-fae28c19-1050-4672-8f93-1c7e77c08544 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2043610494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9ae0bc-94f8-469a-9224-7486937045d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23dd9b1144fa4fdaa98a7c07322f8108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:23:43Z,use_quota=True,user_id='294ceb58122942b39bec08ea3585625b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Creating volume fb9ae0bc-94f8-469a-9224-7486937045d9 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:23:46 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-fb9ae0bc-94f8-469a-9224-7486937045d9 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:46 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-226f2d7b-b062-4453-96ac-95e9a615e007 tempest-VolumesActionsTest-802193143 None] Copy volume to image completed successfully. Sep 17 07:23:46 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-fb9ae0bc-94f8-469a-9224-7486937045d9 1073741824 Sep 17 07:23:46 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-ba1c2708-e9a5-4438-942f-ca595dbada2d req-fae28c19-1050-4672-8f93-1c7e77c08544 tempest-AttachVolumeTestJSON-1860146425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82c97ea4-6d04-4b55-8765-dff4b0d106cb', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:23:46 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-ba1c2708-e9a5-4438-942f-ca595dbada2d req-fae28c19-1050-4672-8f93-1c7e77c08544 tempest-AttachVolumeTestJSON-1860146425 None] attachment_update completed successfully. Sep 17 07:23:47 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-fb9ae0bc-94f8-469a-9224-7486937045d9 1073741824" returned: 0 in 0.538s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-fb9ae0bc-94f8-469a-9224-7486937045d9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:47 devstack sudo[94506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-fb9ae0bc-94f8-469a-9224-7486937045d9 Sep 17 07:23:47 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:47 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-fb9ae0bc-94f8-469a-9224-7486937045d9" returned: 0 in 0.311s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:23:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9cb9b38-c9af-4382-8fb3-7d8e950858d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb9ae0bc-94f8-469a-9224-7486937045d9', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94070c7f-2ad9-46b7-a433-54eeeffdc9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:47 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Volume volume-fb9ae0bc-94f8-469a-9224-7486937045d9 (fb9ae0bc-94f8-469a-9224-7486937045d9): created successfully Sep 17 07:23:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94070c7f-2ad9-46b7-a433-54eeeffdc9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Flow 'volume_create_manager' (b23853eb-c4be-4482-9281-3b89a87d6454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:23:47 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-344e8779-c401-4872-92a7-93255d160c72 tempest-AttachVolumeNegativeTest-3299601 None] Created volume successfully. Sep 17 07:23:48 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Acquiring lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:23:48 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:23:48 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Acquiring lock "cinder-quobyte-94812f01-b995-40a1-85a0-0fb5611532fa" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:23:48 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Lock "cinder-quobyte-94812f01-b995-40a1-85a0-0fb5611532fa" acquired by "delete_volume" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:23:48 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a1bbd6-39aa-4292-b79f-c50ac8f75065]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:23:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:48 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa Sep 17 07:23:48 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:48 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa" returned: 0 in 0.517s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:48 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa Sep 17 07:23:48 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:49 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94812f01-b995-40a1-85a0-0fb5611532fa" returned: 0 in 0.341s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Lock "cinder-quobyte-94812f01-b995-40a1-85a0-0fb5611532fa" released by "delete_volume" :: held 0.916s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:23:49 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Created reservations ['eb4ca9d0-1fd9-42ab-8844-e3b5ac04028a', '3e1cfc4f-8eb9-449d-b729-38dd7d9013c7', '8766c96f-9779-4564-96a4-6f2c3dfaa596', '3f157ffb-51e1-45f3-a68f-304d2c474f07'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:23:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:23:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:23:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:49 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:23:49 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:23:49 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Sep 17 07:23:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.409s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:23:49 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:23:49 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Deleted volume successfully. Sep 17 07:23:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c049ada0-1cfc-46cd-8861-28634fccb2a6 tempest-VolumesActionsTest-802193143 None] Lock "cinder-94812f01-b995-40a1-85a0-0fb5611532fa-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:23:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-7cbd9130-d7cc-47ea-9789-52f79c5d423f req-ec37a08f-fef1-4a25-93da-3384cd800824 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-7cbd9130-d7cc-47ea-9789-52f79c5d423f req-ec37a08f-fef1-4a25-93da-3384cd800824 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-7cbd9130-d7cc-47ea-9789-52f79c5d423f req-ec37a08f-fef1-4a25-93da-3384cd800824 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-7cbd9130-d7cc-47ea-9789-52f79c5d423f req-ec37a08f-fef1-4a25-93da-3384cd800824 tempest-AttachVolumeNegativeTest-3299601 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-fb9ae0bc-94f8-469a-9224-7486937045d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4cf72d87-37a0-438d-ab5e-d563050f3ff0', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:23:50 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-7cbd9130-d7cc-47ea-9789-52f79c5d423f req-ec37a08f-fef1-4a25-93da-3384cd800824 tempest-AttachVolumeNegativeTest-3299601 None] attachment_update completed successfully. Sep 17 07:23:53 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-02b845de-0ce1-4fae-99eb-5215d9114cef req-779533f8-2d7d-48de-9c71-7e6a3098be5e tempest-AttachVolumeNegativeTest-3299601 None] Terminate volume connection completed successfully. Sep 17 07:23:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02b845de-0ce1-4fae-99eb-5215d9114cef req-779533f8-2d7d-48de-9c71-7e6a3098be5e tempest-AttachVolumeNegativeTest-3299601 None] Deleting attachment 4cf72d87-37a0-438d-ab5e-d563050f3ff0. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Flow 'volume_create_manager' (ed4ca177-b34a-48bd-9c55-31878ded3e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d4396f-b07b-4119-9811-9825f1b39a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d4396f-b07b-4119-9811-9825f1b39a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1606976045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0104921c-602a-404f-91c2-a6f170f5f11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aabe8c13144df3a42deec3f1e05deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:23:59Z,use_quota=True,user_id='b5653d3a933f4e55b03f069902c5a6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223ae563-213e-411e-8b60-280b6c42b7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223ae563-213e-411e-8b60-280b6c42b7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb89f261-3b87-408f-8750-3934d3103592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb89f261-3b87-408f-8750-3934d3103592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0104921c-602a-404f-91c2-a6f170f5f11b', 'volume_name': 'volume-0104921c-602a-404f-91c2-a6f170f5f11b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0e5699-795f-40e1-bbb1-fc32e4b79ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0e5699-795f-40e1-bbb1-fc32e4b79ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fc7382-36c7-4e12-99e2-0da44f14a285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:23:59 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Volume 0104921c-602a-404f-91c2-a6f170f5f11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0104921c-602a-404f-91c2-a6f170f5f11b', 'volume_size': 1} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1606976045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0104921c-602a-404f-91c2-a6f170f5f11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aabe8c13144df3a42deec3f1e05deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:23:59Z,use_quota=True,user_id='b5653d3a933f4e55b03f069902c5a6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Creating volume 0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:23:59 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:23:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:23:59 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b 1073741824 Sep 17 07:23:59 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:00 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b 1073741824" returned: 0 in 0.626s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:00 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b Sep 17 07:24:00 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:00 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b" returned: 0 in 0.365s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:24:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fc7382-36c7-4e12-99e2-0da44f14a285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0104921c-602a-404f-91c2-a6f170f5f11b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:24:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1fec43-e1bf-4cbc-9f9a-da63c2b6398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:24:00 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Volume volume-0104921c-602a-404f-91c2-a6f170f5f11b (0104921c-602a-404f-91c2-a6f170f5f11b): created successfully Sep 17 07:24:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1fec43-e1bf-4cbc-9f9a-da63c2b6398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:24:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Flow 'volume_create_manager' (ed4ca177-b34a-48bd-9c55-31878ded3e27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:24:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0ad9f239-e16b-49d5-bd47-45617cb2cd11 tempest-SnapshotsActionsTest-1641858200 None] Created volume successfully. Sep 17 07:24:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] Creating offline snapshot 88e91284-1415-4846-8fb1-4b23071879cb of volume 0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:24:01 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a0e08d-4e7c-4c9b-bedb-9e3f51a0e19d]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:02 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b Sep 17 07:24:02 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:02 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b" returned: 0 in 0.520s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:02 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb 1G Sep 17 07:24:02 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:03 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb 1G" returned: 0 in 0.580s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:03 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb Sep 17 07:24:03 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:03 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb" returned: 0 in 0.399s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:03 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb is being set with open permissions: ugo+rw Sep 17 07:24:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:03 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb Sep 17 07:24:03 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:03 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb" returned: 0 in 0.283s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:03 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.info Sep 17 07:24:03 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:04 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.info" returned: 0 in 0.373s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:04 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.info is being set with open permissions: ugo+rw Sep 17 07:24:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:04 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.info Sep 17 07:24:04 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:04 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.info" returned: 0 in 0.450s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.740s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:04 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-7f979502-dcc6-4abd-8b4d-8ddbb425e03e tempest-SnapshotsActionsTest-1641858200 None] Create snapshot completed successfully Sep 17 07:24:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:24:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:24:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:24:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:04 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:24:04 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:05 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.390s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:24:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:24:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:24:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:24:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] Creating offline snapshot 9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 of volume 0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:24:06 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[39014253-5b94-4fdc-96dc-b6c6af238727]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:06 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb Sep 17 07:24:06 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:07 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb" returned: 0 in 0.815s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0104921c-602a-404f-91c2-a6f170f5f11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:24:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:07 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 1G Sep 17 07:24:07 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:07 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 1G" returned: 0 in 0.736s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:07 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 Sep 17 07:24:07 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:08 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9" returned: 0 in 0.676s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:08 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 is being set with open permissions: ugo+rw Sep 17 07:24:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:08 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 Sep 17 07:24:08 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:08 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9" returned: 0 in 0.351s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.767s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:08 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3dcc728e-07ba-48f2-a98f-647c3d8fdc86 tempest-SnapshotsActionsTest-1641858200 None] Create snapshot completed successfully Sep 17 07:24:09 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Acquiring lock "cinder-9f71f854-6156-4632-b1c9-6d3fb7bdd1f9-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:09 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-9f71f854-6156-4632-b1c9-6d3fb7bdd1f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:09 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Acquiring lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:09 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:09 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Acquiring lock "cinder-quobyte-9f71f854-6156-4632-b1c9-6d3fb7bdd1f9" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:09 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-9f71f854-6156-4632-b1c9-6d3fb7bdd1f9" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Deleting offline snapshot 9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 of volume 0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:24:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] snapshot_file for this snap is: volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:24:09 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f42968-d554-44b6-9bd3-39e9963ff134]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:09 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 Sep 17 07:24:09 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:10 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9" returned: 0 in 0.494s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:10 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0104921c-602a-404f-91c2-a6f170f5f11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:24:10 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb1dac-5d5d-4e0a-93c0-9d4fa69da7b8]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:10 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb Sep 17 07:24:10 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:10 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb" returned: 0 in 0.562s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:10 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0104921c-602a-404f-91c2-a6f170f5f11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:24:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:10 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 Sep 17 07:24:10 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:11 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9" returned: 0 in 0.461s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:11 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9 Sep 17 07:24:11 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:11 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.9f71f854-6156-4632-b1c9-6d3fb7bdd1f9" returned: 0 in 0.315s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-9f71f854-6156-4632-b1c9-6d3fb7bdd1f9" released by "_delete_snapshot" :: held 1.977s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" released by "delete_snapshot" :: held 2.027s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:11 devstack cinder-volume[86029]: WARNING cinder.quota [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:24:11 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Created reservations ['17e0ee67-5468-405e-805e-ce6891d7834f', '29e832f5-34cd-4421-b241-1036ebe3ff1e', '299a618f-b219-41fa-916a-29754db5077f', '53057d98-78e3-47c7-b6fe-887779331e43'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:24:11 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Delete snapshot completed successfully. Sep 17 07:24:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f375a518-385c-4795-b0fc-4de7018a5238 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-9f71f854-6156-4632-b1c9-6d3fb7bdd1f9-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:13 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] Creating offline snapshot 0895bbc5-1a08-4224-a1f8-b4e39730fb1f of volume 0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:24:13 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65c590b-91b9-463e-bd6f-be5712a79fc3]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:13 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb Sep 17 07:24:13 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:14 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb" returned: 0 in 0.643s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0104921c-602a-404f-91c2-a6f170f5f11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:24:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:14 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f 1G Sep 17 07:24:14 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:14 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f 1G" returned: 0 in 0.733s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:14 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f Sep 17 07:24:14 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:15 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f" returned: 0 in 0.470s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:15 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f is being set with open permissions: ugo+rw Sep 17 07:24:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:15 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f Sep 17 07:24:15 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:15 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f" returned: 0 in 0.423s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:15 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-95599d9d-e7c5-4a32-8e8e-1e427bed286f tempest-SnapshotsActionsTest-1641858200 None] Create snapshot completed successfully Sep 17 07:24:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Acquiring lock "cinder-0895bbc5-1a08-4224-a1f8-b4e39730fb1f-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-0895bbc5-1a08-4224-a1f8-b4e39730fb1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Acquiring lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Acquiring lock "cinder-quobyte-0895bbc5-1a08-4224-a1f8-b4e39730fb1f" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-0895bbc5-1a08-4224-a1f8-b4e39730fb1f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Deleting offline snapshot 0895bbc5-1a08-4224-a1f8-b4e39730fb1f of volume 0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:24:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] snapshot_file for this snap is: volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:24:17 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6766928c-be05-4c1f-9523-321008f1e84b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:17 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f Sep 17 07:24:17 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:17 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f" returned: 0 in 0.596s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0104921c-602a-404f-91c2-a6f170f5f11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:24:17 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1174cf63-c1be-4e54-8e37-16618a594e3a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:17 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb Sep 17 07:24:17 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:18 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb" returned: 0 in 0.612s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0104921c-602a-404f-91c2-a6f170f5f11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:24:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:18 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f Sep 17 07:24:18 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:18 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f" returned: 0 in 0.619s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:19 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f Sep 17 07:24:19 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:19 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.0895bbc5-1a08-4224-a1f8-b4e39730fb1f" returned: 0 in 0.404s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-0895bbc5-1a08-4224-a1f8-b4e39730fb1f" released by "_delete_snapshot" :: held 2.416s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" released by "delete_snapshot" :: held 2.457s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:19 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Created reservations ['89e63bc3-5306-4a3b-9c98-a080a161cb5c', '4791d6dc-c592-43db-9a25-89c9705b19e8', '3f5f0595-fafc-4054-906c-50c414fd7904', '7274e9dc-2c67-4bd5-acea-8542e101588f'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:24:19 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Delete snapshot completed successfully. Sep 17 07:24:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bc09ea4a-0ebd-4de1-9833-c117af7779d6 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-0895bbc5-1a08-4224-a1f8-b4e39730fb1f-delete_snapshot" released by "delete_snapshot" :: held 2.703s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] Creating offline snapshot e28aeda5-56e2-41ae-be8a-ba7e45b5786b of volume 0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:24:20 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c196928e-d160-44b6-a7eb-fba663358831]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:20 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb Sep 17 07:24:20 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:21 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb" returned: 0 in 0.429s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0104921c-602a-404f-91c2-a6f170f5f11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:24:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:21 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b 1G Sep 17 07:24:21 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:21 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b 1G" returned: 0 in 0.580s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:21 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b Sep 17 07:24:21 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:22 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b" returned: 0 in 0.457s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:22 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b is being set with open permissions: ugo+rw Sep 17 07:24:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:22 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b Sep 17 07:24:22 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:22 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-bcc2fd7c-e07b-4982-a73d-15a4e2b94676 req-0abacfea-10d5-4634-b9f5-babae11bcf59 tempest-AttachVolumeTestJSON-1860146425 None] Terminate volume connection completed successfully. Sep 17 07:24:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-bcc2fd7c-e07b-4982-a73d-15a4e2b94676 req-0abacfea-10d5-4634-b9f5-babae11bcf59 tempest-AttachVolumeTestJSON-1860146425 None] Deleting attachment 82c97ea4-6d04-4b55-8765-dff4b0d106cb. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:24:22 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b" returned: 0 in 0.477s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:22 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3afb0ac5-f155-40ef-910d-d35ee1357505 tempest-SnapshotsActionsTest-1641858200 None] Create snapshot completed successfully Sep 17 07:24:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Acquiring lock "cinder-e28aeda5-56e2-41ae-be8a-ba7e45b5786b-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-e28aeda5-56e2-41ae-be8a-ba7e45b5786b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Acquiring lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Acquiring lock "cinder-quobyte-e28aeda5-56e2-41ae-be8a-ba7e45b5786b" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-e28aeda5-56e2-41ae-be8a-ba7e45b5786b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Deleting offline snapshot e28aeda5-56e2-41ae-be8a-ba7e45b5786b of volume 0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:24:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] snapshot_file for this snap is: volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:24:24 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce32fa65-6e65-4d2a-bc05-70fb3045b430]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:24 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b Sep 17 07:24:24 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:24 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b" returned: 0 in 0.602s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0104921c-602a-404f-91c2-a6f170f5f11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:24:24 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a10975d-77e5-4c6e-a29c-208fe0cb2615]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:24 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb Sep 17 07:24:24 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:25 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb" returned: 0 in 0.733s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0104921c-602a-404f-91c2-a6f170f5f11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:24:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:25 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b Sep 17 07:24:25 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:26 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b" returned: 0 in 0.578s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:26 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b Sep 17 07:24:26 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:26 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.e28aeda5-56e2-41ae-be8a-ba7e45b5786b" returned: 0 in 0.399s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-e28aeda5-56e2-41ae-be8a-ba7e45b5786b" released by "_delete_snapshot" :: held 2.462s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" released by "delete_snapshot" :: held 2.504s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:26 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Created reservations ['b23a2ca5-5d73-45af-b9bf-abe380eed9f6', '0c7e08e9-0f77-4a75-916c-2be49d369b7e', '0df2ee4f-8c7a-49c6-8e8f-2f4a7d13c47d', 'ddacca4f-ffb5-463e-9eb1-ad822cc65f0a'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:24:26 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Delete snapshot completed successfully. Sep 17 07:24:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb9e6cf9-613d-499e-a244-477eb1ec163a tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-e28aeda5-56e2-41ae-be8a-ba7e45b5786b-delete_snapshot" released by "delete_snapshot" :: held 2.751s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] Creating offline snapshot 8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 of volume 0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:24:28 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55c2b76-2208-41d0-808c-985c527e5ea9]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:28 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb Sep 17 07:24:28 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:28 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb" returned: 0 in 0.611s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0104921c-602a-404f-91c2-a6f170f5f11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:24:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:28 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 1G Sep 17 07:24:28 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:29 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 1G" returned: 0 in 0.940s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:29 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 Sep 17 07:24:29 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:30 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7" returned: 0 in 0.653s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:30 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 is being set with open permissions: ugo+rw Sep 17 07:24:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:30 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 Sep 17 07:24:30 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:30 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7" returned: 0 in 0.407s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:30 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=68,cinder:UPDATE=64,cinder:INSERT=20,cinder:DELETE=2 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:24:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.861s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:30 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b53cd334-c491-404c-8f87-6de3b4942daa tempest-SnapshotsActionsTest-1641858200 None] Create snapshot completed successfully Sep 17 07:24:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Acquiring lock "cinder-8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Acquiring lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Acquiring lock "cinder-quobyte-8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Deleting offline snapshot 8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 of volume 0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:24:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] snapshot_file for this snap is: volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:24:31 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[01390a71-d5a7-4f1e-aa03-a6965d046d66]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:31 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 Sep 17 07:24:31 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:31 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7" returned: 0 in 0.504s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0104921c-602a-404f-91c2-a6f170f5f11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:24:31 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[032e83c3-323d-47b5-a380-7ba338138b22]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:31 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb Sep 17 07:24:31 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:32 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb" returned: 0 in 0.641s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0104921c-602a-404f-91c2-a6f170f5f11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:24:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:32 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 Sep 17 07:24:32 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:32 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7" returned: 0 in 0.557s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:33 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7 Sep 17 07:24:33 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:33 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7" returned: 0 in 0.292s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:33 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7" released by "_delete_snapshot" :: held 2.161s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:33 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" released by "delete_snapshot" :: held 2.194s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:33 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=87,cinder:UPDATE=65,cinder:DELETE=8,cinder:INSERT=11 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:24:33 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Created reservations ['eea7962a-10ba-4917-baeb-cafc5674e4f2', '4070284e-09a8-4deb-8ad4-d3e0c217b6c6', 'f91b00e3-231b-4d20-9dd0-3b7fdd9cdb18', '0ed54c85-ef13-4e70-81b8-13c0f35b79c3'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:24:33 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Delete snapshot completed successfully. Sep 17 07:24:33 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0282a9a7-1a80-48e9-96ee-d8e7b00b06e6 tempest-SnapshotsActionsTest-920258112 None] Lock "cinder-8bd80ea8-0b3e-4676-9bf7-c9fe2545d3a7-delete_snapshot" released by "delete_snapshot" :: held 2.386s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Acquiring lock "cinder-88e91284-1415-4846-8fb1-4b23071879cb-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Lock "cinder-88e91284-1415-4846-8fb1-4b23071879cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Acquiring lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Acquiring lock "cinder-quobyte-88e91284-1415-4846-8fb1-4b23071879cb" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Lock "cinder-quobyte-88e91284-1415-4846-8fb1-4b23071879cb" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Deleting offline snapshot 88e91284-1415-4846-8fb1-4b23071879cb of volume 0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:24:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] snapshot_file for this snap is: volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:24:35 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1473ec29-8674-4964-8f96-112f8af95aec]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:35 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb Sep 17 07:24:35 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:35 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb" returned: 0 in 0.646s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0104921c-602a-404f-91c2-a6f170f5f11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:24:35 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1217def5-550c-4747-8142-13cb930b269a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:36 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b Sep 17 07:24:36 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:36 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b" returned: 0 in 0.671s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:36 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb Sep 17 07:24:36 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:36 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb" returned: 0 in 0.383s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:37 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb Sep 17 07:24:37 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:37 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b.88e91284-1415-4846-8fb1-4b23071879cb" returned: 0 in 0.309s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Lock "cinder-quobyte-88e91284-1415-4846-8fb1-4b23071879cb" released by "_delete_snapshot" :: held 2.229s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" released by "delete_snapshot" :: held 2.267s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:37 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Created reservations ['3e608d71-7cf4-41c5-a0b7-c333271c93b9', '2819b053-f379-4a60-a204-4067daf1027d', 'cc7ed4cf-e3dd-410e-8621-bba93dbe761b', '635510a6-59e5-47cd-ae97-df92a0c8e3e1'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:24:37 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Delete snapshot completed successfully. Sep 17 07:24:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-10e315a0-731d-47fa-b0ad-b6d44070734b tempest-SnapshotsActionsTest-1641858200 None] Lock "cinder-88e91284-1415-4846-8fb1-4b23071879cb-delete_snapshot" released by "delete_snapshot" :: held 2.516s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Flow 'volume_create_manager' (f758e70a-5357-42d8-a187-f87ecfb3d8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973baf27-0bee-4523-bd7c-5c8201d93466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973baf27-0bee-4523-bd7c-5c8201d93466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1776548248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f9bf44-ecf5-4d8e-99a9-bb1c84de4029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23dd9b1144fa4fdaa98a7c07322f8108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:24:38Z,use_quota=True,user_id='294ceb58122942b39bec08ea3585625b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18919ef-f98d-48df-8687-cd9aebd7dc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18919ef-f98d-48df-8687-cd9aebd7dc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91176e6-9f64-49a0-b186-5afa072620b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91176e6-9f64-49a0-b186-5afa072620b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f9bf44-ecf5-4d8e-99a9-bb1c84de4029', 'volume_name': 'volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e364057-7a59-4ff1-9d2f-4ef8e719fb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e364057-7a59-4ff1-9d2f-4ef8e719fb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99b6c56-0f32-4b0f-8044-6f80aec9e6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:24:38 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Volume 00f9bf44-ecf5-4d8e-99a9-bb1c84de4029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029', 'volume_size': 1} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1776548248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f9bf44-ecf5-4d8e-99a9-bb1c84de4029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23dd9b1144fa4fdaa98a7c07322f8108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:24:38Z,use_quota=True,user_id='294ceb58122942b39bec08ea3585625b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Creating volume 00f9bf44-ecf5-4d8e-99a9-bb1c84de4029 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:24:38 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:38 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029 1073741824 Sep 17 07:24:38 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Acquiring lock "cinder-0104921c-602a-404f-91c2-a6f170f5f11b-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Lock "cinder-0104921c-602a-404f-91c2-a6f170f5f11b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Acquiring lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" acquired by "delete_volume" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[47766dda-bb44-41a7-b369-5eb2370c3896]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:38 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b Sep 17 07:24:38 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:39 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b" returned: 0 in 0.821s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:39 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029 1073741824" returned: 0 in 1.325s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:39 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b Sep 17 07:24:39 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:39 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029 Sep 17 07:24:39 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:40 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029" returned: 0 in 0.433s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99b6c56-0f32-4b0f-8044-6f80aec9e6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00ce95a-1d84-4dc8-92e3-ce7a4e00b06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:24:40 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Volume volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029 (00f9bf44-ecf5-4d8e-99a9-bb1c84de4029): created successfully Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00ce95a-1d84-4dc8-92e3-ce7a4e00b06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Flow 'volume_create_manager' (f758e70a-5357-42d8-a187-f87ecfb3d8cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:24:40 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2e8d97a5-a602-4675-9e81-da87f8e77c95 tempest-AttachVolumeNegativeTest-3299601 None] Created volume successfully. Sep 17 07:24:40 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-0104921c-602a-404f-91c2-a6f170f5f11b" returned: 0 in 0.736s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Lock "cinder-quobyte-0104921c-602a-404f-91c2-a6f170f5f11b" released by "delete_volume" :: held 1.793s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Created reservations ['dda9d99c-9a20-4300-b4a6-050259b00107', '51dc2452-6c4d-4d88-b649-47af2af25b23', '0dd58a96-0718-4f76-a5ed-d583e2f458bb', 'da4db8b2-bf95-45a3-8a97-e7d8cf6ca8c5'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:40 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:24:40 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:41 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.698s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:41 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:24:41 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Deleted volume successfully. Sep 17 07:24:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-96385ba8-32ba-41aa-ba27-e78c418687f7 tempest-SnapshotsActionsTest-1641858200 None] Lock "cinder-0104921c-602a-404f-91c2-a6f170f5f11b-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-c27a1a06-775b-40d1-9661-c34ec8fbc3fc req-c9bde2d7-2203-4211-b958-e34c94b07d29 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-c27a1a06-775b-40d1-9661-c34ec8fbc3fc req-c9bde2d7-2203-4211-b958-e34c94b07d29 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-c27a1a06-775b-40d1-9661-c34ec8fbc3fc req-c9bde2d7-2203-4211-b958-e34c94b07d29 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-c27a1a06-775b-40d1-9661-c34ec8fbc3fc req-c9bde2d7-2203-4211-b958-e34c94b07d29 tempest-AttachVolumeNegativeTest-3299601 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ccb4af53-e9e8-4ff2-adea-f07e0246e610', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:24:42 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-c27a1a06-775b-40d1-9661-c34ec8fbc3fc req-c9bde2d7-2203-4211-b958-e34c94b07d29 tempest-AttachVolumeNegativeTest-3299601 None] attachment_update completed successfully. Sep 17 07:24:46 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-47c63629-9083-442b-bf33-0e2cbcae8dd9 req-d0dd6167-0b3f-41a4-a194-254963a17a4b tempest-AttachVolumeNegativeTest-3299601 None] Terminate volume connection completed successfully. Sep 17 07:24:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-47c63629-9083-442b-bf33-0e2cbcae8dd9 req-d0dd6167-0b3f-41a4-a194-254963a17a4b tempest-AttachVolumeNegativeTest-3299601 None] Deleting attachment ccb4af53-e9e8-4ff2-adea-f07e0246e610. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Flow 'volume_create_manager' (d360b8fe-a78c-4f45-aef1-ee6a24a2e0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60845d53-ee89-44c6-9ad1-dd40d2843743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60845d53-ee89-44c6-9ad1-dd40d2843743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-88548371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e618924-48d1-4203-9282-13fa6a9d9a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3d31582ba049b9a68deed32afea866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:24:50Z,use_quota=True,user_id='b54b55e2391a466fb27f8d06e71d800b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10bf5043-0f5e-4bfc-9ab4-0b84ac63193f),volume_type_id=10bf5043-0f5e-4bfc-9ab4-0b84ac63193f)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9139200f-c0d2-42ff-b6fa-df8d8a50b4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9139200f-c0d2-42ff-b6fa-df8d8a50b4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33280500-a097-4f2b-aea3-56a7a36acda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33280500-a097-4f2b-aea3-56a7a36acda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e618924-48d1-4203-9282-13fa6a9d9a27', 'volume_name': 'volume-5e618924-48d1-4203-9282-13fa6a9d9a27', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de018b71-eeb4-4e30-b53d-a632766cbf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de018b71-eeb4-4e30-b53d-a632766cbf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a16572-a8a4-419c-a06b-944c94f8293c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:24:50 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Volume 5e618924-48d1-4203-9282-13fa6a9d9a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e618924-48d1-4203-9282-13fa6a9d9a27', 'volume_size': 1} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-88548371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e618924-48d1-4203-9282-13fa6a9d9a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3d31582ba049b9a68deed32afea866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:24:50Z,use_quota=True,user_id='b54b55e2391a466fb27f8d06e71d800b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10bf5043-0f5e-4bfc-9ab4-0b84ac63193f),volume_type_id=10bf5043-0f5e-4bfc-9ab4-0b84ac63193f)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Creating volume 5e618924-48d1-4203-9282-13fa6a9d9a27 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:24:50 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:24:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5e618924-48d1-4203-9282-13fa6a9d9a27 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:50 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5e618924-48d1-4203-9282-13fa6a9d9a27 1073741824 Sep 17 07:24:50 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:51 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5e618924-48d1-4203-9282-13fa6a9d9a27 1073741824" returned: 0 in 0.584s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5e618924-48d1-4203-9282-13fa6a9d9a27 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:51 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5e618924-48d1-4203-9282-13fa6a9d9a27 Sep 17 07:24:51 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "cinder-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Lock "cinder-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "cinder-quobyte-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Lock "cinder-quobyte-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029" acquired by "delete_volume" :: waited 0.048s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[816b9de8-6d1b-4485-9e3b-01073913b732]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:51 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5e618924-48d1-4203-9282-13fa6a9d9a27" returned: 0 in 0.398s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a16572-a8a4-419c-a06b-944c94f8293c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e618924-48d1-4203-9282-13fa6a9d9a27', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360e4862-8111-413c-a392-682c89901636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:24:51 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Volume volume-5e618924-48d1-4203-9282-13fa6a9d9a27 (5e618924-48d1-4203-9282-13fa6a9d9a27): created successfully Sep 17 07:24:51 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029 Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360e4862-8111-413c-a392-682c89901636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:24:51 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Flow 'volume_create_manager' (d360b8fe-a78c-4f45-aef1-ee6a24a2e0d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:24:51 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-053a6594-a4d6-4d1b-b26e-a749a4e5325f tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Created volume successfully. Sep 17 07:24:51 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029" returned: 0 in 0.413s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:51 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029 Sep 17 07:24:51 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:52 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029" returned: 0 in 0.273s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Lock "cinder-quobyte-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029" released by "delete_volume" :: held 0.756s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Created reservations ['30da4d1b-e8b7-4662-9401-075562cafdbc', '35e766d7-88e9-4f26-8892-a9cc79b0db90', '5800b874-fe49-497d-9cf0-8f9eb0d71aa1', '9de380df-4ded-4b54-9d86-fd2d75b6b94d'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:52 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:24:52 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.308s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:52 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:24:52 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Deleted volume successfully. Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8939007e-6d10-4d01-be90-58778d11ff58 tempest-AttachVolumeNegativeTest-3299601 None] Lock "cinder-00f9bf44-ecf5-4d8e-99a9-bb1c84de4029-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "cinder-fb9ae0bc-94f8-469a-9224-7486937045d9-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Lock "cinder-fb9ae0bc-94f8-469a-9224-7486937045d9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "cinder-quobyte-fb9ae0bc-94f8-469a-9224-7486937045d9" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Lock "cinder-quobyte-fb9ae0bc-94f8-469a-9224-7486937045d9" acquired by "delete_volume" :: waited 0.050s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:53 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19db000-c88b-4bd0-99ba-e41690a29bfd]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-fb9ae0bc-94f8-469a-9224-7486937045d9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:53 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-fb9ae0bc-94f8-469a-9224-7486937045d9 Sep 17 07:24:53 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-15dc4c08-faf3-45bc-9b97-38fbea8dd192 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-15dc4c08-faf3-45bc-9b97-38fbea8dd192 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-15dc4c08-faf3-45bc-9b97-38fbea8dd192 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:24:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-15dc4c08-faf3-45bc-9b97-38fbea8dd192 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:24:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-15dc4c08-faf3-45bc-9b97-38fbea8dd192 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-15dc4c08-faf3-45bc-9b97-38fbea8dd192 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:53 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:24:53 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:53 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-15dc4c08-faf3-45bc-9b97-38fbea8dd192 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.538s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:53 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-15dc4c08-faf3-45bc-9b97-38fbea8dd192 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:24:53 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-15dc4c08-faf3-45bc-9b97-38fbea8dd192 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Retype volume completed successfully. Sep 17 07:24:53 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-fb9ae0bc-94f8-469a-9224-7486937045d9" returned: 0 in 0.874s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-fb9ae0bc-94f8-469a-9224-7486937045d9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:53 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-fb9ae0bc-94f8-469a-9224-7486937045d9 Sep 17 07:24:53 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:54 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-fb9ae0bc-94f8-469a-9224-7486937045d9" returned: 0 in 0.309s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Lock "cinder-quobyte-fb9ae0bc-94f8-469a-9224-7486937045d9" released by "delete_volume" :: held 1.264s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Created reservations ['10773468-5094-4c2b-a7c0-7ad305835f25', 'f2b8d772-2351-411b-af67-f8a05dcc9482', '3a899a26-5aef-4c90-82a7-17e7e45e5be0', 'f306f094-8828-45bd-9ed7-f8f0f744e51f'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:54 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:24:54 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Acquiring lock "cinder-5e618924-48d1-4203-9282-13fa6a9d9a27-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Lock "cinder-5e618924-48d1-4203-9282-13fa6a9d9a27-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Acquiring lock "cinder-quobyte-5e618924-48d1-4203-9282-13fa6a9d9a27" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Lock "cinder-quobyte-5e618924-48d1-4203-9282-13fa6a9d9a27" acquired by "delete_volume" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b7f9b6-ceee-49a5-9554-b58accefae26]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5e618924-48d1-4203-9282-13fa6a9d9a27 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:54 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.507s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:54 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:24:54 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Deleted volume successfully. Sep 17 07:24:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-94b511c2-562d-4069-9311-c82542dbad18 tempest-AttachVolumeNegativeTest-3299601 None] Lock "cinder-fb9ae0bc-94f8-469a-9224-7486937045d9-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:55 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5e618924-48d1-4203-9282-13fa6a9d9a27 Sep 17 07:24:55 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:55 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5e618924-48d1-4203-9282-13fa6a9d9a27" returned: 0 in 0.560s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5e618924-48d1-4203-9282-13fa6a9d9a27 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:55 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5e618924-48d1-4203-9282-13fa6a9d9a27 Sep 17 07:24:55 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "cinder-5f06e285-d2eb-4ee8-acec-e25124614141-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Lock "cinder-5f06e285-d2eb-4ee8-acec-e25124614141-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "cinder-quobyte-5f06e285-d2eb-4ee8-acec-e25124614141" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:24:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Lock "cinder-quobyte-5f06e285-d2eb-4ee8-acec-e25124614141" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:24:55 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3408e96-13ed-41cd-932e-92e4554c10cd]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:24:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f06e285-d2eb-4ee8-acec-e25124614141 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:55 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5e618924-48d1-4203-9282-13fa6a9d9a27" returned: 0 in 0.343s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:55 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f06e285-d2eb-4ee8-acec-e25124614141 Sep 17 07:24:55 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Lock "cinder-quobyte-5e618924-48d1-4203-9282-13fa6a9d9a27" released by "delete_volume" :: held 0.992s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:55 devstack cinder-volume[86029]: WARNING cinder.quota [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:24:55 devstack cinder-volume[86029]: WARNING cinder.quota [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:24:55 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Created reservations ['75d42ea6-9790-4fed-9989-ccfc162f80a9', '21a1669b-cc4a-43ab-859c-da31f8213e35', '54fd2ec2-6978-410c-a08d-5f091eb4fda6', 'c3a620be-b19e-4dcc-8958-3daf7490a267'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:56 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:24:56 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:56 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f06e285-d2eb-4ee8-acec-e25124614141" returned: 0 in 0.506s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f06e285-d2eb-4ee8-acec-e25124614141 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:56 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f06e285-d2eb-4ee8-acec-e25124614141 Sep 17 07:24:56 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:56 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.333s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:24:56 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Deleted volume successfully. Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e79c9de9-517f-441e-85b9-f04d67bf9b56 tempest-VolumeRetypeWithoutMigrationTest-884713521 None] Lock "cinder-5e618924-48d1-4203-9282-13fa6a9d9a27-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:56 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f06e285-d2eb-4ee8-acec-e25124614141" returned: 0 in 0.317s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Lock "cinder-quobyte-5f06e285-d2eb-4ee8-acec-e25124614141" released by "delete_volume" :: held 0.878s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Created reservations ['d4d6992b-ec81-4bf9-8dc2-b92ac83f6659', '7c5b0404-4f77-4cd3-864e-38ebe63d9653', '176988c6-2c0d-42c3-837d-b7d7362668bd', '1ea0f28e-2daf-4ec1-8bd8-c895ccd39959'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:24:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:24:56 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:24:56 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:57 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.343s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:24:57 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:24:57 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Deleted volume successfully. Sep 17 07:24:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7a5b367b-326f-495e-925a-cd9a22fed263 tempest-AttachVolumeNegativeTest-3299601 None] Lock "cinder-5f06e285-d2eb-4ee8-acec-e25124614141-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:25:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:04 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:25:04 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:05 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.365s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:25:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:25:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:25:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Flow 'volume_create_manager' (55b2e5a2-9842-4d77-9cea-d10bad4ac282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950e279b-441d-4de6-9c4a-bdad3a2b3c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950e279b-441d-4de6-9c4a-bdad3a2b3c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1567373402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2dc890a-e57a-4d85-8244-fc74c943c3d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1e1505f01b4afa9bebbe20fc86d27f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:25:06Z,use_quota=True,user_id='fb164eaf572c4f19b77724b8f05ca538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caccae22-e219-4571-ba06-77eee228a849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caccae22-e219-4571-ba06-77eee228a849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ed0a92-641e-41c4-b54b-6309c0e5028f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ed0a92-641e-41c4-b54b-6309c0e5028f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2dc890a-e57a-4d85-8244-fc74c943c3d1', 'volume_name': 'volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ddd3b2-5d83-4465-9ec6-d49c86f6a32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ddd3b2-5d83-4465-9ec6-d49c86f6a32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f108b45d-255c-4994-a38c-c7c09f234159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:06 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Volume a2dc890a-e57a-4d85-8244-fc74c943c3d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1', 'volume_size': 1} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1567373402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2dc890a-e57a-4d85-8244-fc74c943c3d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1e1505f01b4afa9bebbe20fc86d27f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:25:06Z,use_quota=True,user_id='fb164eaf572c4f19b77724b8f05ca538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Creating volume a2dc890a-e57a-4d85-8244-fc74c943c3d1 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:25:06 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:25:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:06 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1 1073741824 Sep 17 07:25:06 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:07 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:25:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Flow 'volume_create_manager' (e8ccaa96-6253-40f3-a8fa-64b5a7556adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:25:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19f673c-179b-4a5e-9603-4106f2649ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19f673c-179b-4a5e-9603-4106f2649ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1433533777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340581c2-e938-45d0-ba62-99f46812c2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c1d304489e437dbf817b93fecd2031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:25:07Z,use_quota=True,user_id='33b1a06a43ef4148846483da06801958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28da0880-4f1e-466a-9c3c-885deb5cefbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28da0880-4f1e-466a-9c3c-885deb5cefbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da7458f-3694-4d98-821b-672784f0385c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da7458f-3694-4d98-821b-672784f0385c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '340581c2-e938-45d0-ba62-99f46812c2cf', 'volume_name': 'volume-340581c2-e938-45d0-ba62-99f46812c2cf', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adca8456-9910-4c25-9b87-f117443198fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adca8456-9910-4c25-9b87-f117443198fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fa1378-dcd4-49cc-85cb-7d46c242a6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:07 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Volume 340581c2-e938-45d0-ba62-99f46812c2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-340581c2-e938-45d0-ba62-99f46812c2cf', 'volume_size': 1} Sep 17 07:25:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:07 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1 1073741824" returned: 0 in 1.175s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:07 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1 Sep 17 07:25:07 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:08 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1" returned: 0 in 0.487s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.889s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1433533777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340581c2-e938-45d0-ba62-99f46812c2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c1d304489e437dbf817b93fecd2031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:25:07Z,use_quota=True,user_id='33b1a06a43ef4148846483da06801958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Creating volume 340581c2-e938-45d0-ba62-99f46812c2cf {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:25:08 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-340581c2-e938-45d0-ba62-99f46812c2cf 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:08 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-340581c2-e938-45d0-ba62-99f46812c2cf 1073741824 Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f108b45d-255c-4994-a38c-c7c09f234159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:08 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd64dc28-4dc7-4ef3-a6a2-ab2dbda1f478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:08 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Volume volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1 (a2dc890a-e57a-4d85-8244-fc74c943c3d1): created successfully Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd64dc28-4dc7-4ef3-a6a2-ab2dbda1f478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Flow 'volume_create_manager' (55b2e5a2-9842-4d77-9cea-d10bad4ac282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:25:08 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d6d63f11-2112-4508-be2e-388d5b14b3f6 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Created volume successfully. Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Flow 'volume_create_manager' (441b1ee1-eda0-4d45-8b90-5a6784b340df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be96c91-abbb-4c53-b0b7-5715ce034c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be96c91-abbb-4c53-b0b7-5715ce034c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-925610551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f11443-7f6c-478c-9695-34e17d6c050b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b93a3ab875945bbbe4cfc58dedf3bb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:25:08Z,use_quota=True,user_id='0543466df1a4408db6b4a68975fb51d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34c77b6-688a-4a77-b67e-87a1b2463446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34c77b6-688a-4a77-b67e-87a1b2463446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe6e57e-b03f-4a80-a6ae-89501ddebb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe6e57e-b03f-4a80-a6ae-89501ddebb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f11443-7f6c-478c-9695-34e17d6c050b', 'volume_name': 'volume-57f11443-7f6c-478c-9695-34e17d6c050b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db9c26a-148c-461c-89f5-9bef0990a9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db9c26a-148c-461c-89f5-9bef0990a9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44285178-b45d-4546-885b-d80b9e29b784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:08 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Volume 57f11443-7f6c-478c-9695-34e17d6c050b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f11443-7f6c-478c-9695-34e17d6c050b', 'volume_size': 1} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:08 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-340581c2-e938-45d0-ba62-99f46812c2cf 1073741824" returned: 0 in 0.697s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-340581c2-e938-45d0-ba62-99f46812c2cf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:09 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-340581c2-e938-45d0-ba62-99f46812c2cf Sep 17 07:25:09 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:09 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-340581c2-e938-45d0-ba62-99f46812c2cf" returned: 0 in 0.326s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.834s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-925610551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f11443-7f6c-478c-9695-34e17d6c050b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b93a3ab875945bbbe4cfc58dedf3bb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:25:08Z,use_quota=True,user_id='0543466df1a4408db6b4a68975fb51d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Creating volume 57f11443-7f6c-478c-9695-34e17d6c050b {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:25:09 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fa1378-dcd4-49cc-85cb-7d46c242a6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-340581c2-e938-45d0-ba62-99f46812c2cf', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:09 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b 1073741824 Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e848b2c2-9185-4d18-a690-ee83b5129b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:09 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:09 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Volume volume-340581c2-e938-45d0-ba62-99f46812c2cf (340581c2-e938-45d0-ba62-99f46812c2cf): created successfully Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e848b2c2-9185-4d18-a690-ee83b5129b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Flow 'volume_create_manager' (e8ccaa96-6253-40f3-a8fa-64b5a7556adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:25:09 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4cfdafc4-b938-4660-8e85-f50337cae1e6 tempest-VolumesServicesTestJSON-647333310 None] Created volume successfully. Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-ed026961-ce30-487a-b726-b9196d0ff873 req-0dad9bc4-7568-4d95-adb3-558f10d823d2 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:09 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b 1073741824" returned: 0 in 0.619s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:10 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b Sep 17 07:25:10 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:10 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b" returned: 0 in 0.257s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:10 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:25:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-ed026961-ce30-487a-b726-b9196d0ff873 req-0dad9bc4-7568-4d95-adb3-558f10d823d2 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.396s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44285178-b45d-4546-885b-d80b9e29b784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f11443-7f6c-478c-9695-34e17d6c050b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6afafba4-6700-415c-9535-8c97ed625047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-ed026961-ce30-487a-b726-b9196d0ff873 req-0dad9bc4-7568-4d95-adb3-558f10d823d2 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:10 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Volume volume-57f11443-7f6c-478c-9695-34e17d6c050b (57f11443-7f6c-478c-9695-34e17d6c050b): created successfully Sep 17 07:25:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6afafba4-6700-415c-9535-8c97ed625047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Flow 'volume_create_manager' (441b1ee1-eda0-4d45-8b90-5a6784b340df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:25:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-ed026961-ce30-487a-b726-b9196d0ff873 req-0dad9bc4-7568-4d95-adb3-558f10d823d2 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9181c06-5ef9-474f-855a-4a4ebbc1dbd8', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:25:10 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-02adaffe-d445-41bb-89ba-58143b82a216 req-d759aebf-0c8d-4674-bda0-92de05b99e0d tempest-VolumesSnapshotsTestJSON-897054651 None] Created volume successfully. Sep 17 07:25:10 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-ed026961-ce30-487a-b726-b9196d0ff873 req-0dad9bc4-7568-4d95-adb3-558f10d823d2 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] attachment_update completed successfully. Sep 17 07:25:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Acquiring lock "cinder-340581c2-e938-45d0-ba62-99f46812c2cf-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] Creating offline snapshot 3c2e5b18-1de2-41af-81b0-ed6dddd96d30 of volume 57f11443-7f6c-478c-9695-34e17d6c050b {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:25:11 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[860b14ce-4b53-44e3-bdf3-5f9838dfd345]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:25:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Lock "cinder-340581c2-e938-45d0-ba62-99f46812c2cf-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Acquiring lock "cinder-quobyte-340581c2-e938-45d0-ba62-99f46812c2cf" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Lock "cinder-quobyte-340581c2-e938-45d0-ba62-99f46812c2cf" acquired by "delete_volume" :: waited 0.042s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:11 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b Sep 17 07:25:11 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:11 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31febfe-a45b-4099-867d-e691673918ed]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:25:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-340581c2-e938-45d0-ba62-99f46812c2cf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:11 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-340581c2-e938-45d0-ba62-99f46812c2cf Sep 17 07:25:11 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:11 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b" returned: 0 in 0.741s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:11 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 1G Sep 17 07:25:11 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:12 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-340581c2-e938-45d0-ba62-99f46812c2cf" returned: 0 in 0.795s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-340581c2-e938-45d0-ba62-99f46812c2cf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:12 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-340581c2-e938-45d0-ba62-99f46812c2cf Sep 17 07:25:12 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:12 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 1G" returned: 0 in 0.715s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57f11443-7f6c-478c-9695-34e17d6c050b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:12 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57f11443-7f6c-478c-9695-34e17d6c050b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 Sep 17 07:25:12 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:12 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-340581c2-e938-45d0-ba62-99f46812c2cf" returned: 0 in 0.448s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Lock "cinder-quobyte-340581c2-e938-45d0-ba62-99f46812c2cf" released by "delete_volume" :: held 1.339s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Created reservations ['d03ad738-2ce1-46a5-bd37-7cdfa1dc4488', '01d0eec1-f07d-4450-9207-3029d50f2d32', '8652ce5f-3160-4de7-a140-7c240d1d9868', '418466de-4a53-4796-a123-a6ff1dd51643'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:12 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:25:12 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:12 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57f11443-7f6c-478c-9695-34e17d6c050b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30" returned: 0 in 0.391s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:12 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 is being set with open permissions: ugo+rw Sep 17 07:25:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:12 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 Sep 17 07:25:12 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:13 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.385s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:13 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:25:13 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Deleted volume successfully. Sep 17 07:25:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cac65f05-33bf-4111-b797-41698b8aa409 tempest-VolumesServicesTestJSON-647333310 None] Lock "cinder-340581c2-e938-45d0-ba62-99f46812c2cf-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:13 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30" returned: 0 in 0.401s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:13 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.info Sep 17 07:25:13 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:13 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.info" returned: 0 in 0.377s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:13 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.info is being set with open permissions: ugo+rw Sep 17 07:25:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:13 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.info Sep 17 07:25:13 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:14 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.info" returned: 0 in 0.332s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.142s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:14 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-0ea2061d-e46f-45b8-a1cb-86acd807c212 req-ed5dbaa0-17a9-496b-b783-fad0677227d8 tempest-VolumesSnapshotsTestJSON-897054651 None] Create snapshot completed successfully Sep 17 07:25:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Acquiring lock "cinder-3c2e5b18-1de2-41af-81b0-ed6dddd96d30-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "cinder-3c2e5b18-1de2-41af-81b0-ed6dddd96d30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Acquiring lock "cinder-quobyte-57f11443-7f6c-478c-9695-34e17d6c050b" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "cinder-quobyte-57f11443-7f6c-478c-9695-34e17d6c050b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Acquiring lock "cinder-quobyte-3c2e5b18-1de2-41af-81b0-ed6dddd96d30" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "cinder-quobyte-3c2e5b18-1de2-41af-81b0-ed6dddd96d30" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Deleting offline snapshot 3c2e5b18-1de2-41af-81b0-ed6dddd96d30 of volume 57f11443-7f6c-478c-9695-34e17d6c050b {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:25:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] snapshot_file for this snap is: volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:25:14 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8a885a-7379-4ba6-9f41-1ce25c753509]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:25:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:14 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 Sep 17 07:25:14 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:15 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30" returned: 0 in 0.512s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57f11443-7f6c-478c-9695-34e17d6c050b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:25:15 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e742fe1-1a79-4b05-a3e7-3927ea73e9e5]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:25:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:15 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b Sep 17 07:25:15 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:15 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-a2c40493-e44f-4853-8907-9a6c465bf7fa req-d049ac7e-c0cf-41ba-b292-5ba0ea45be0c tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Terminate volume connection completed successfully. Sep 17 07:25:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-a2c40493-e44f-4853-8907-9a6c465bf7fa req-d049ac7e-c0cf-41ba-b292-5ba0ea45be0c tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Deleting attachment b9181c06-5ef9-474f-855a-4a4ebbc1dbd8. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:25:15 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b" returned: 0 in 0.613s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:16 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 Sep 17 07:25:16 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:16 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30" returned: 0 in 0.426s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:16 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30 Sep 17 07:25:16 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Acquiring lock "cinder-a2dc890a-e57a-4d85-8244-fc74c943c3d1-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Lock "cinder-a2dc890a-e57a-4d85-8244-fc74c943c3d1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Acquiring lock "cinder-quobyte-a2dc890a-e57a-4d85-8244-fc74c943c3d1" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Lock "cinder-quobyte-a2dc890a-e57a-4d85-8244-fc74c943c3d1" acquired by "delete_volume" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:16 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7484db16-5d40-452d-8b4f-0500e3f0f6fc]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:25:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:16 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b.3c2e5b18-1de2-41af-81b0-ed6dddd96d30" returned: 0 in 0.429s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:16 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1 Sep 17 07:25:16 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "cinder-quobyte-3c2e5b18-1de2-41af-81b0-ed6dddd96d30" released by "_delete_snapshot" :: held 2.151s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "cinder-quobyte-57f11443-7f6c-478c-9695-34e17d6c050b" released by "delete_snapshot" :: held 2.183s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:17 devstack cinder-volume[86029]: DEBUG cinder.quota [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Created reservations ['aa0fbd97-2e91-42ad-9aee-5897e46623c7', '1f02c44a-261d-48a8-ba9c-678f7251ba86', '9efc5450-28e6-4e6b-a4a0-28cd857ceee9', '2d5cd1ab-decf-4b56-b904-82260d64d448'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:25:17 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Delete snapshot completed successfully. Sep 17 07:25:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-b4793277-8b16-4f8f-87e8-07e1213d0b96 req-259d09a5-f93c-4b4c-9c74-b792f1cff715 tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "cinder-3c2e5b18-1de2-41af-81b0-ed6dddd96d30-delete_snapshot" released by "delete_snapshot" :: held 2.384s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:17 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1" returned: 0 in 0.522s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:17 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1 Sep 17 07:25:17 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:17 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2dc890a-e57a-4d85-8244-fc74c943c3d1" returned: 0 in 0.298s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Lock "cinder-quobyte-a2dc890a-e57a-4d85-8244-fc74c943c3d1" released by "delete_volume" :: held 0.893s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:17 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Created reservations ['f50ff06a-98d6-47c3-b3e8-3e02be36a282', 'a1b7153e-6ff6-4c19-a71b-7027042bc10a', '0517e63d-c260-4436-a92d-c3f5b6fca89c', '85cebcfc-eeb8-4679-9030-5f85e1ee22d9'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:25:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:17 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:25:17 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:18 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.403s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:18 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:25:18 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Deleted volume successfully. Sep 17 07:25:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Acquiring lock "cinder-57f11443-7f6c-478c-9695-34e17d6c050b-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-64b82796-d323-4feb-a357-57fe3a983282 tempest-TestServerVolumeAttachScenarioOldVersion-1516847529 None] Lock "cinder-a2dc890a-e57a-4d85-8244-fc74c943c3d1-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "cinder-57f11443-7f6c-478c-9695-34e17d6c050b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Acquiring lock "cinder-quobyte-57f11443-7f6c-478c-9695-34e17d6c050b" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "cinder-quobyte-57f11443-7f6c-478c-9695-34e17d6c050b" acquired by "delete_volume" :: waited 0.032s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:18 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f928e25-9dcc-402a-b8ea-6eed990320d6]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:25:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:18 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b Sep 17 07:25:18 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:19 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b" returned: 0 in 0.685s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:19 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b Sep 17 07:25:19 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:19 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-57f11443-7f6c-478c-9695-34e17d6c050b" returned: 0 in 0.498s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "cinder-quobyte-57f11443-7f6c-478c-9695-34e17d6c050b" released by "delete_volume" :: held 1.290s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:19 devstack cinder-volume[86029]: DEBUG cinder.quota [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Created reservations ['64bcfcb8-a858-4bbb-ac5c-687d328251b8', '80ef518d-ee21-4412-966b-ea8998691b6d', '9f9e87e9-cf8e-4c6b-b32e-635a50de86e1', '043cdc8c-b767-4fa1-a384-6f92f9357365'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:25:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:19 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:25:19 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:20 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.364s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:20 devstack cinder-volume[86029]: DEBUG cinder.manager [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:25:20 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Deleted volume successfully. Sep 17 07:25:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-5c76bb7d-f79e-42ab-be21-aed72b41fcbd req-49d376f0-fe0a-4d1c-9ffc-f9d8a7d51dd5 tempest-VolumesSnapshotsTestJSON-897054651 None] Lock "cinder-57f11443-7f6c-478c-9695-34e17d6c050b-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:26 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-9e291e5c-d265-4578-8941-94479e6376ab tempest-GroupSnapshotsV319Test-127525234 None] Group tempest-GroupSnapshotsV319Test-Group-704588678: creating Sep 17 07:25:26 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-9e291e5c-d265-4578-8941-94479e6376ab tempest-GroupSnapshotsV319Test-127525234 None] Group tempest-GroupSnapshotsV319Test-Group-704588678: created successfully Sep 17 07:25:26 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-9e291e5c-d265-4578-8941-94479e6376ab tempest-GroupSnapshotsV319Test-127525234 None] Create group completed successfully. Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Flow 'volume_create_manager' (fd63ad22-4658-4a29-a559-1678dba4efac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737a45fb-3041-4889-8959-225eec426f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737a45fb-3041-4889-8959-225eec426f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1432800338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c936e7d1-5d50-45dd-938b-455a6d5d3567,host='devstack@QuobyteHD#QuobyteHD',id=828b2297-b491-4831-b9ae-a343d80d6fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='356c3d892a5f4c329ade862011e8cf80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:25:28Z,use_quota=True,user_id='06d13dd857924f27a59dd10631ceceff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(750ff4c7-9c7d-4ba8-b1e0-85ea6ec0ce80),volume_type_id=750ff4c7-9c7d-4ba8-b1e0-85ea6ec0ce80)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c950f77-fcfc-4afc-aba9-9e73688c56a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c950f77-fcfc-4afc-aba9-9e73688c56a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3088424-abfb-4e92-a2e2-590b65408cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3088424-abfb-4e92-a2e2-590b65408cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '828b2297-b491-4831-b9ae-a343d80d6fe3', 'volume_name': 'volume-828b2297-b491-4831-b9ae-a343d80d6fe3', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762e4c2f-ed9d-41d0-bc22-7ad82223945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762e4c2f-ed9d-41d0-bc22-7ad82223945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df44a202-3c04-44e9-bf89-8f3a9d7b7266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:28 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Volume 828b2297-b491-4831-b9ae-a343d80d6fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-828b2297-b491-4831-b9ae-a343d80d6fe3', 'volume_size': 1} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c936e7d1-5d50-45dd-938b-455a6d5d3567,created_at=2026-09-17T05:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1432800338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c936e7d1-5d50-45dd-938b-455a6d5d3567,host='devstack@QuobyteHD#QuobyteHD',id=828b2297-b491-4831-b9ae-a343d80d6fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='356c3d892a5f4c329ade862011e8cf80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:25:28Z,use_quota=True,user_id='06d13dd857924f27a59dd10631ceceff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(750ff4c7-9c7d-4ba8-b1e0-85ea6ec0ce80),volume_type_id=750ff4c7-9c7d-4ba8-b1e0-85ea6ec0ce80)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Creating volume 828b2297-b491-4831-b9ae-a343d80d6fe3 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:25:28 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:28 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3 1073741824 Sep 17 07:25:28 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:28 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3 1073741824" returned: 0 in 0.592s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:28 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3 Sep 17 07:25:28 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:29 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3" returned: 0 in 0.338s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:25:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df44a202-3c04-44e9-bf89-8f3a9d7b7266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-828b2297-b491-4831-b9ae-a343d80d6fe3', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a69ff2-4d7c-482a-b880-b007e8224f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:29 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Volume volume-828b2297-b491-4831-b9ae-a343d80d6fe3 (828b2297-b491-4831-b9ae-a343d80d6fe3): created successfully Sep 17 07:25:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a69ff2-4d7c-482a-b880-b007e8224f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Flow 'volume_create_manager' (fd63ad22-4658-4a29-a559-1678dba4efac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:25:29 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a082f129-5866-4ef6-a45f-ec68f1fe65fe tempest-GroupSnapshotsV319Test-127525234 None] Created volume successfully. Sep 17 07:25:31 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] GroupSnapshot c29f9c78-3461-4ad0-8358-6a09f2ab5123: creating. Sep 17 07:25:31 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=104,cinder:INSERT=30,cinder:UPDATE=108,cinder:DELETE=5 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:25:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] Group snapshot c29f9c78-3461-4ad0-8358-6a09f2ab5123: creating. {{(pid=86029) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 07:25:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] Creating offline snapshot 3ce57451-b3ea-4151-80f2-faba434f8773 of volume 828b2297-b491-4831-b9ae-a343d80d6fe3 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:25:31 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b61bb3c-7db3-40bb-b5c2-488276090894]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:25:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:31 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3 Sep 17 07:25:31 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:31 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3" returned: 0 in 0.530s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:31 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 1G Sep 17 07:25:31 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:32 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 1G" returned: 0 in 0.625s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828b2297-b491-4831-b9ae-a343d80d6fe3 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:32 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828b2297-b491-4831-b9ae-a343d80d6fe3 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 Sep 17 07:25:32 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:32 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828b2297-b491-4831-b9ae-a343d80d6fe3 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773" returned: 0 in 0.437s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:32 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 07:25:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:32 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 Sep 17 07:25:32 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Flow 'volume_create_manager' (83ccaef1-043d-41c3-a20c-196e2e64d7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d15151-8d8a-401e-8f17-88f371d41bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d15151-8d8a-401e-8f17-88f371d41bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1011006797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e85589-a968-460d-a968-501b70083089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='318b790836dc4c76b1ef46741593cc63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:25:33Z,use_quota=True,user_id='5c1fb15bca79409db1015204b8a03ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae256a72-c00b-4358-9d5a-848ad3d710b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae256a72-c00b-4358-9d5a-848ad3d710b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605cb372-438d-4677-8bb0-5fd439431a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605cb372-438d-4677-8bb0-5fd439431a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e85589-a968-460d-a968-501b70083089', 'volume_name': 'volume-a2e85589-a968-460d-a968-501b70083089', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91f4973-22cc-4f61-b22c-e59877b2e6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91f4973-22cc-4f61-b22c-e59877b2e6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5633ac-6488-4845-8c68-648ecd08799c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:33 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Volume a2e85589-a968-460d-a968-501b70083089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e85589-a968-460d-a968-501b70083089', 'volume_size': 1} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:33 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773" returned: 0 in 0.338s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:33 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.info Sep 17 07:25:33 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:33 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.info" returned: 0 in 0.386s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:33 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:33 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.info Sep 17 07:25:33 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:33 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.info" returned: 0 in 0.327s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.761s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.813s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1011006797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e85589-a968-460d-a968-501b70083089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='318b790836dc4c76b1ef46741593cc63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:25:33Z,use_quota=True,user_id='5c1fb15bca79409db1015204b8a03ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Creating volume a2e85589-a968-460d-a968-501b70083089 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:25:33 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2e85589-a968-460d-a968-501b70083089 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:33 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:INSERT=21,cinder:UPDATE=110,cinder:SELECT=91,cinder:DELETE=10 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:25:33 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2e85589-a968-460d-a968-501b70083089 1073741824 Sep 17 07:25:33 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:34 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e6e01e21-fbec-4b9b-8882-ade942666817 tempest-GroupSnapshotsV319Test-127525234 None] group_snapshot c29f9c78-3461-4ad0-8358-6a09f2ab5123: created successfully Sep 17 07:25:34 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2e85589-a968-460d-a968-501b70083089 1073741824" returned: 0 in 0.668s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2e85589-a968-460d-a968-501b70083089 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:34 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2e85589-a968-460d-a968-501b70083089 Sep 17 07:25:34 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:34 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:34 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] group_snapshot c29f9c78-3461-4ad0-8358-6a09f2ab5123: deleting Sep 17 07:25:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2e85589-a968-460d-a968-501b70083089" returned: 0 in 0.346s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:34 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:25:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5633ac-6488-4845-8c68-648ecd08799c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e85589-a968-460d-a968-501b70083089', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a21653-35a8-45b8-8ee7-aa4670dd6fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] group_snapshot c29f9c78-3461-4ad0-8358-6a09f2ab5123: deleting {{(pid=86029) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 07:25:35 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Volume volume-a2e85589-a968-460d-a968-501b70083089 (a2e85589-a968-460d-a968-501b70083089): created successfully Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a21653-35a8-45b8-8ee7-aa4670dd6fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Flow 'volume_create_manager' (83ccaef1-043d-41c3-a20c-196e2e64d7e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Acquiring lock "cinder-quobyte-828b2297-b491-4831-b9ae-a343d80d6fe3" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:35 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b805477d-1f86-4c64-97db-ddde29767fe6 tempest-AttachVolumeTestJSON-1860146425 None] Created volume successfully. Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Lock "cinder-quobyte-828b2297-b491-4831-b9ae-a343d80d6fe3" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Acquiring lock "cinder-quobyte-3ce57451-b3ea-4151-80f2-faba434f8773" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Lock "cinder-quobyte-3ce57451-b3ea-4151-80f2-faba434f8773" acquired by "_delete_snapshot" :: waited 0.073s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Deleting offline snapshot 3ce57451-b3ea-4151-80f2-faba434f8773 of volume 828b2297-b491-4831-b9ae-a343d80d6fe3 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] snapshot_file for this snap is: volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c4d791-97f4-4545-a9f1-de1740db3554]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:35 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 Sep 17 07:25:35 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:35 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773" returned: 0 in 0.437s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828b2297-b491-4831-b9ae-a343d80d6fe3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[164bd6b3-0e13-4e1b-9390-f09ba02de862]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:25:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:35 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3 Sep 17 07:25:35 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:36 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3" returned: 0 in 0.521s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:36 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 Sep 17 07:25:36 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:36 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773" returned: 0 in 0.550s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:36 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773 Sep 17 07:25:36 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-85978cb7-41ed-465f-a54e-fe37997ae192 req-73b58a14-2683-4e9b-a88d-9bbdb0887f4c tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-85978cb7-41ed-465f-a54e-fe37997ae192 req-73b58a14-2683-4e9b-a88d-9bbdb0887f4c tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-85978cb7-41ed-465f-a54e-fe37997ae192 req-73b58a14-2683-4e9b-a88d-9bbdb0887f4c tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:37 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3.3ce57451-b3ea-4151-80f2-faba434f8773" returned: 0 in 0.308s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Lock "cinder-quobyte-3ce57451-b3ea-4151-80f2-faba434f8773" released by "_delete_snapshot" :: held 1.991s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Lock "cinder-quobyte-828b2297-b491-4831-b9ae-a343d80d6fe3" released by "delete_snapshot" :: held 2.094s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-85978cb7-41ed-465f-a54e-fe37997ae192 req-73b58a14-2683-4e9b-a88d-9bbdb0887f4c tempest-AttachVolumeTestJSON-1860146425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-a2e85589-a968-460d-a968-501b70083089', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45135fdf-ca8f-47f8-996b-506c9addbf38', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:25:37 devstack cinder-volume[86029]: WARNING cinder.quota [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-936649103 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-936649103, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:25:37 devstack cinder-volume[86029]: WARNING cinder.quota [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-936649103 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-936649103, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:25:37 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-85978cb7-41ed-465f-a54e-fe37997ae192 req-73b58a14-2683-4e9b-a88d-9bbdb0887f4c tempest-AttachVolumeTestJSON-1860146425 None] attachment_update completed successfully. Sep 17 07:25:37 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] Created reservations ['ae49fd30-b317-4420-8850-b922101936da', '55a711c2-70af-44b1-b29f-9468399f0160', '41d1a76c-6f11-432b-8463-d7becfb81434', '85641bf7-c5b8-44c8-be28-a635e662b361'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:25:37 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a835abb5-14cf-412b-a643-b7d8442167af tempest-GroupSnapshotsV319Test-127525234 None] group_snapshot c29f9c78-3461-4ad0-8358-6a09f2ab5123: deleted successfully Sep 17 07:25:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Acquiring lock "cinder-quobyte-828b2297-b491-4831-b9ae-a343d80d6fe3" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Lock "cinder-quobyte-828b2297-b491-4831-b9ae-a343d80d6fe3" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:38 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3efcb5e-3a49-4f1b-849a-1af38e4f0e66]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:25:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:39 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3 Sep 17 07:25:39 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:39 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3" returned: 0 in 0.608s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:39 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3 Sep 17 07:25:39 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:39 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-828b2297-b491-4831-b9ae-a343d80d6fe3" returned: 0 in 0.328s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Lock "cinder-quobyte-828b2297-b491-4831-b9ae-a343d80d6fe3" released by "delete_volume" :: held 1.070s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Created reservations ['677b7f45-4842-4d7a-b047-9c8171c44a4e'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:25:40 devstack cinder-volume[86029]: WARNING cinder.quota [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-936649103 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-936649103, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Created reservations ['120454df-d4be-44a8-9c3b-bc8215d75e3c', 'c2f8e5d4-c2d6-4f1d-a435-a9f23e3363e0', 'd9f59ea7-a1a1-4f41-8578-038c536c141f', '2ec2fe4e-8ccf-4814-9b55-a7d3880d7e00'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Flow 'volume_create_manager' (f396ad47-c659-4fb5-84ac-cf00f88e7493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274d0f30-a644-4051-a7cf-e50bfce8479f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274d0f30-a644-4051-a7cf-e50bfce8479f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2070495822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77f1fc3-f4d3-47cf-adb6-c5efa43a272c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='318b790836dc4c76b1ef46741593cc63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:25:40Z,use_quota=True,user_id='5c1fb15bca79409db1015204b8a03ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bf9a0f-16f9-4cf4-b0e4-8946c8336a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bf9a0f-16f9-4cf4-b0e4-8946c8336a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1c1b0b-c112-4c1a-a441-b373b0ea1dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1c1b0b-c112-4c1a-a441-b373b0ea1dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd77f1fc3-f4d3-47cf-adb6-c5efa43a272c', 'volume_name': 'volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4553fe79-99d1-46dc-a877-8d0c759b41a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4553fe79-99d1-46dc-a877-8d0c759b41a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbab319-aa15-4637-8952-f66455b9fdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:40 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Volume d77f1fc3-f4d3-47cf-adb6-c5efa43a272c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c', 'volume_size': 1} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2070495822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77f1fc3-f4d3-47cf-adb6-c5efa43a272c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='318b790836dc4c76b1ef46741593cc63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:25:40Z,use_quota=True,user_id='5c1fb15bca79409db1015204b8a03ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Creating volume d77f1fc3-f4d3-47cf-adb6-c5efa43a272c {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:25:40 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:40 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c 1073741824 Sep 17 07:25:40 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:40 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:25:40 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:40 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.438s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:25:40 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b6f04146-b3d0-4639-8e1a-f0ba9a862215 tempest-GroupSnapshotsV319Test-127525234 None] Delete group completed successfully. Sep 17 07:25:40 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c 1073741824" returned: 0 in 0.616s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:41 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c Sep 17 07:25:41 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:41 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c" returned: 0 in 0.347s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:25:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbab319-aa15-4637-8952-f66455b9fdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7b08d3-968f-4d5a-aa9c-8da9fef6214d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:41 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Volume volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c (d77f1fc3-f4d3-47cf-adb6-c5efa43a272c): created successfully Sep 17 07:25:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7b08d3-968f-4d5a-aa9c-8da9fef6214d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Flow 'volume_create_manager' (f396ad47-c659-4fb5-84ac-cf00f88e7493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:25:41 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a0f11aab-515f-4ceb-a8aa-5c00567189fc tempest-AttachVolumeTestJSON-1860146425 None] Created volume successfully. Sep 17 07:25:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-2492abdc-0898-41a4-a958-220f565aadfe req-a94d0490-d41c-4de9-9abb-bbd5a1076390 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-2492abdc-0898-41a4-a958-220f565aadfe req-a94d0490-d41c-4de9-9abb-bbd5a1076390 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-2492abdc-0898-41a4-a958-220f565aadfe req-a94d0490-d41c-4de9-9abb-bbd5a1076390 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-2492abdc-0898-41a4-a958-220f565aadfe req-a94d0490-d41c-4de9-9abb-bbd5a1076390 tempest-AttachVolumeTestJSON-1860146425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71a06562-9bcb-4e00-a5fe-d41c945393e1', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:25:43 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-2492abdc-0898-41a4-a958-220f565aadfe req-a94d0490-d41c-4de9-9abb-bbd5a1076390 tempest-AttachVolumeTestJSON-1860146425 None] attachment_update completed successfully. Sep 17 07:25:46 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-87a7e324-a930-45c6-ac32-d95a4d0dd5c8 req-16370a7a-05eb-4de6-996e-b36f64da57b9 tempest-AttachVolumeTestJSON-1860146425 None] Terminate volume connection completed successfully. Sep 17 07:25:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-87a7e324-a930-45c6-ac32-d95a4d0dd5c8 req-16370a7a-05eb-4de6-996e-b36f64da57b9 tempest-AttachVolumeTestJSON-1860146425 None] Deleting attachment 45135fdf-ca8f-47f8-996b-506c9addbf38. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:25:48 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-3b85b2a3-406b-4c60-af3c-127e38897186 req-946ca8c9-05c7-422a-9a11-83ec790e6d1f tempest-AttachVolumeTestJSON-1860146425 None] Terminate volume connection completed successfully. Sep 17 07:25:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-3b85b2a3-406b-4c60-af3c-127e38897186 req-946ca8c9-05c7-422a-9a11-83ec790e6d1f tempest-AttachVolumeTestJSON-1860146425 None] Deleting attachment 71a06562-9bcb-4e00-a5fe-d41c945393e1. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:25:51 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-480afd2e-d7f3-47df-b159-1e3d6721c019 tempest-GroupsV320Test-673691567 None] Group tempest-GroupsV320Test-Group-34854767: creating Sep 17 07:25:51 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-480afd2e-d7f3-47df-b159-1e3d6721c019 tempest-GroupsV320Test-673691567 None] Group tempest-GroupsV320Test-Group-34854767: created successfully Sep 17 07:25:52 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-480afd2e-d7f3-47df-b159-1e3d6721c019 tempest-GroupsV320Test-673691567 None] Create group completed successfully. Sep 17 07:25:54 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-fff21166-acbb-4686-8642-d94871f8d901 tempest-GroupsV320Test-673691567 None] Created reservations ['48e02e14-1511-4e46-a4c9-c1a1537d28ea'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:25:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fff21166-acbb-4686-8642-d94871f8d901 tempest-GroupsV320Test-673691567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fff21166-acbb-4686-8642-d94871f8d901 tempest-GroupsV320Test-673691567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-fff21166-acbb-4686-8642-d94871f8d901 tempest-GroupsV320Test-673691567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-fff21166-acbb-4686-8642-d94871f8d901 tempest-GroupsV320Test-673691567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fff21166-acbb-4686-8642-d94871f8d901 tempest-GroupsV320Test-673691567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fff21166-acbb-4686-8642-d94871f8d901 tempest-GroupsV320Test-673691567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:54 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:25:54 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:54 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fff21166-acbb-4686-8642-d94871f8d901 tempest-GroupsV320Test-673691567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.446s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:54 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-fff21166-acbb-4686-8642-d94871f8d901 tempest-GroupsV320Test-673691567 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:25:54 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-fff21166-acbb-4686-8642-d94871f8d901 tempest-GroupsV320Test-673691567 None] Delete group completed successfully. Sep 17 07:25:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "cinder-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Lock "cinder-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "cinder-quobyte-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Lock "cinder-quobyte-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c" acquired by "delete_volume" :: waited 0.044s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:55 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c377f946-2172-41b9-a05a-6f366b12bb73]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:25:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:55 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c Sep 17 07:25:55 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:56 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c" returned: 0 in 0.668s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:56 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c Sep 17 07:25:56 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:56 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c" returned: 0 in 0.438s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Lock "cinder-quobyte-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c" released by "delete_volume" :: held 1.220s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:56 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Created reservations ['51039ddf-ff6b-4653-82ad-599cb0d56495', 'c9a20eb8-82ac-4364-b63d-b3adce172c12', 'e465f66f-1a63-4b38-8aff-97d78c57187a', '58fc87e6-df60-4b88-ab23-c8a58a8ca00d'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:25:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:56 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:25:56 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:57 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.330s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:57 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:25:57 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Deleted volume successfully. Sep 17 07:25:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dd4573ca-01c6-4909-9e85-13f70d8feea1 tempest-AttachVolumeTestJSON-1860146425 None] Lock "cinder-d77f1fc3-f4d3-47cf-adb6-c5efa43a272c-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "cinder-a2e85589-a968-460d-a968-501b70083089-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Lock "cinder-a2e85589-a968-460d-a968-501b70083089-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "cinder-quobyte-a2e85589-a968-460d-a968-501b70083089" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:25:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Lock "cinder-quobyte-a2e85589-a968-460d-a968-501b70083089" acquired by "delete_volume" :: waited 0.038s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:25:58 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d78c2dd-218c-44d6-a3c9-1fa1f0b08bbd]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:25:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2e85589-a968-460d-a968-501b70083089 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:58 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2e85589-a968-460d-a968-501b70083089 Sep 17 07:25:58 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:58 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2e85589-a968-460d-a968-501b70083089" returned: 0 in 0.700s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2e85589-a968-460d-a968-501b70083089 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:58 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2e85589-a968-460d-a968-501b70083089 Sep 17 07:25:58 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:59 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a2e85589-a968-460d-a968-501b70083089" returned: 0 in 0.428s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Lock "cinder-quobyte-a2e85589-a968-460d-a968-501b70083089" released by "delete_volume" :: held 1.225s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Created reservations ['c221e675-1c97-4658-bdeb-d4c473dcbb76', '04682b91-0aab-4787-965b-dedd85bdc9dc', '3505befb-01ae-4ce6-ac40-8c3d9f87293d', '0f532bbc-02c6-4433-b1df-2796aec26928'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Flow 'volume_create_manager' (c02c51e0-26af-40e0-a9ea-a70c77433dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e0eeb1-be7c-4efe-94a6-8c79c7eb987d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e0eeb1-be7c-4efe-94a6-8c79c7eb987d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1989597522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ccd404-2b29-4f2c-b1dd-9215beadf8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4401c4fa2bd147809f85bc3749586600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:25:59Z,use_quota=True,user_id='174bfa5535fa4b60b280d169c4593001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670c8e52-b95e-48d0-b5ae-2616b34784a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670c8e52-b95e-48d0-b5ae-2616b34784a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9835cd3-882e-4f6c-923b-5e3dbf3bccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9835cd3-882e-4f6c-923b-5e3dbf3bccd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1ccd404-2b29-4f2c-b1dd-9215beadf8a6', 'volume_name': 'volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b25307-dc72-4d1b-9994-81c3c6419934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b25307-dc72-4d1b-9994-81c3c6419934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1d8402-b590-482d-96d6-21b3f2344eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:25:59 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Volume c1ccd404-2b29-4f2c-b1dd-9215beadf8a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6', 'volume_size': 1} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1989597522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ccd404-2b29-4f2c-b1dd-9215beadf8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4401c4fa2bd147809f85bc3749586600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:25:59Z,use_quota=True,user_id='174bfa5535fa4b60b280d169c4593001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Creating volume c1ccd404-2b29-4f2c-b1dd-9215beadf8a6 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:25:59 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:59 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6 1073741824 Sep 17 07:25:59 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:25:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:25:59 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:25:59 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:00 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.410s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:26:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Deleted volume successfully. Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e48c821f-93b0-438e-a705-c6f151ab8704 tempest-AttachVolumeTestJSON-1860146425 None] Lock "cinder-a2e85589-a968-460d-a968-501b70083089-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:00 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6 1073741824" returned: 0 in 0.771s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "cinder-a8b12e2b-3744-409a-9dc9-3b658259b6c8-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Lock "cinder-a8b12e2b-3744-409a-9dc9-3b658259b6c8-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:00 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6 Sep 17 07:26:00 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "cinder-quobyte-a8b12e2b-3744-409a-9dc9-3b658259b6c8" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Lock "cinder-quobyte-a8b12e2b-3744-409a-9dc9-3b658259b6c8" acquired by "delete_volume" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef6aefc-34e6-4949-87b5-c501eed7effb]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:00 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8 Sep 17 07:26:00 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:00 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6" returned: 0 in 0.416s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1d8402-b590-482d-96d6-21b3f2344eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb118682-cbd6-49a1-9ab7-93d56132a18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:00 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Volume volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6 (c1ccd404-2b29-4f2c-b1dd-9215beadf8a6): created successfully Sep 17 07:26:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb118682-cbd6-49a1-9ab7-93d56132a18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Flow 'volume_create_manager' (c02c51e0-26af-40e0-a9ea-a70c77433dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-59cb66f3-31ab-48c4-8f9e-5a4c4672241b tempest-VolumesActionsTest-799470292 None] Created volume successfully. Sep 17 07:26:01 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8" returned: 0 in 0.729s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:01 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8 Sep 17 07:26:01 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c13dc6fb-b0b8-4bb2-bd46-cf98f45d9865 tempest-VolumesActionsTest-799470292 None] Acquiring lock "cinder-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6" by "attach_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c13dc6fb-b0b8-4bb2-bd46-cf98f45d9865 tempest-VolumesActionsTest-799470292 None] Lock "cinder-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6" acquired by "attach_volume" :: waited 0.075s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-c13dc6fb-b0b8-4bb2-bd46-cf98f45d9865 tempest-VolumesActionsTest-799470292 None] Attaching volume c1ccd404-2b29-4f2c-b1dd-9215beadf8a6 to instance 8fef05ed-cd7e-430d-a9a7-aa4ec235efdf at mountpoint /dev/vdb on host None. Sep 17 07:26:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-c13dc6fb-b0b8-4bb2-bd46-cf98f45d9865 tempest-VolumesActionsTest-799470292 None] Attach volume completed successfully. Sep 17 07:26:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c13dc6fb-b0b8-4bb2-bd46-cf98f45d9865 tempest-VolumesActionsTest-799470292 None] Lock "cinder-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6" released by "attach_volume" :: held 0.213s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:02 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a8b12e2b-3744-409a-9dc9-3b658259b6c8" returned: 0 in 0.653s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Lock "cinder-quobyte-a8b12e2b-3744-409a-9dc9-3b658259b6c8" released by "delete_volume" :: held 1.458s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:02 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Created reservations ['c47dbf1c-e2d1-4507-96c7-8350074fcd37', 'fa8b564f-f1d8-4660-9435-2611fa56ef09', '5cd87e6b-358c-44f3-b910-e69b519cac3f', '10ca938f-db3f-477b-a55e-a8d7be4ed4b0'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:26:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:02 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:26:02 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:02 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.446s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:02 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:26:02 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Deleted volume successfully. Sep 17 07:26:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2ce70bc2-e290-4f73-9058-e3fe32bd3fb0 tempest-AttachVolumeTestJSON-1860146425 None] Lock "cinder-a8b12e2b-3744-409a-9dc9-3b658259b6c8-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:03 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a5d2f8c3-c26d-4c14-adf4-16fcde4bf12f tempest-VolumesActionsTest-1554546313 None] Terminate volume connection completed successfully. Sep 17 07:26:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a5d2f8c3-c26d-4c14-adf4-16fcde4bf12f tempest-VolumesActionsTest-1554546313 None] Acquiring lock "cinder-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6-detach_volume" by "detach_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a5d2f8c3-c26d-4c14-adf4-16fcde4bf12f tempest-VolumesActionsTest-1554546313 None] Lock "cinder-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:03 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a5d2f8c3-c26d-4c14-adf4-16fcde4bf12f tempest-VolumesActionsTest-1554546313 None] Detaching volume c1ccd404-2b29-4f2c-b1dd-9215beadf8a6 from instance 8fef05ed-cd7e-430d-a9a7-aa4ec235efdf. Sep 17 07:26:03 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a5d2f8c3-c26d-4c14-adf4-16fcde4bf12f tempest-VolumesActionsTest-1554546313 None] Detach volume completed successfully. Sep 17 07:26:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a5d2f8c3-c26d-4c14-adf4-16fcde4bf12f tempest-VolumesActionsTest-1554546313 None] Lock "cinder-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6-detach_volume" released by "detach_volume" :: held 0.169s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b2fa7863-be5c-40c1-9fc8-973f0b7b0451 tempest-VolumesActionsTest-799470292 None] Acquiring lock "cinder-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6-detach_volume" by "detach_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b2fa7863-be5c-40c1-9fc8-973f0b7b0451 tempest-VolumesActionsTest-799470292 None] Lock "cinder-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:03 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b2fa7863-be5c-40c1-9fc8-973f0b7b0451 tempest-VolumesActionsTest-799470292 None] Volume detach called, but volume not attached. Sep 17 07:26:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b2fa7863-be5c-40c1-9fc8-973f0b7b0451 tempest-VolumesActionsTest-799470292 None] Lock "cinder-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6-detach_volume" released by "detach_volume" :: held 0.045s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Acquiring lock "cinder-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Lock "cinder-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Acquiring lock "cinder-quobyte-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Lock "cinder-quobyte-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6" acquired by "delete_volume" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e97821e-61d5-4553-b0ae-8c7ad8882f1c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:04 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6 Sep 17 07:26:04 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:04 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:26:04 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:04 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6" returned: 0 in 0.515s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:05 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6 Sep 17 07:26:05 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:05 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.361s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:26:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:26:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:26:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:26:05 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6" returned: 0 in 0.703s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Lock "cinder-quobyte-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6" released by "delete_volume" :: held 1.277s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:05 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Created reservations ['c2f3d1a4-1dc3-487e-8fd2-fd30f144045d', '5f055aaa-154d-425f-b9d1-839cbae1eaf6', '2e3c87db-2844-4e71-b495-6b6f59b52eca', '9945eb7e-504a-47e8-8b6d-158de3bb12e8'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:26:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:05 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:26:05 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:06 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.421s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:06 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:26:06 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Deleted volume successfully. Sep 17 07:26:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8d121b1e-6fd6-45d7-a9d7-864b03ad66e0 tempest-VolumesActionsTest-799470292 None] Lock "cinder-c1ccd404-2b29-4f2c-b1dd-9215beadf8a6-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Flow 'volume_create_manager' (976a9781-1a42-46f5-b80c-27843e371dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0288a6-4361-41fd-8680-0117f9ecc496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0288a6-4361-41fd-8680-0117f9ecc496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-213285521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d84db8-8e39-48d3-8dab-da25358d04d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4401c4fa2bd147809f85bc3749586600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:13Z,use_quota=True,user_id='174bfa5535fa4b60b280d169c4593001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466d869a-f82d-4377-acf2-43685b1c7e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466d869a-f82d-4377-acf2-43685b1c7e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6089078c-4083-42e1-8097-8548d48bad9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6089078c-4083-42e1-8097-8548d48bad9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d84db8-8e39-48d3-8dab-da25358d04d7', 'volume_name': 'volume-40d84db8-8e39-48d3-8dab-da25358d04d7', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72617f90-4ac4-41bf-a877-273e36ed5ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72617f90-4ac4-41bf-a877-273e36ed5ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f361c0-0991-4b30-bda7-8d8f3492d2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:12 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Volume 40d84db8-8e39-48d3-8dab-da25358d04d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d84db8-8e39-48d3-8dab-da25358d04d7', 'volume_size': 1} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-213285521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d84db8-8e39-48d3-8dab-da25358d04d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4401c4fa2bd147809f85bc3749586600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:13Z,use_quota=True,user_id='174bfa5535fa4b60b280d169c4593001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Creating volume 40d84db8-8e39-48d3-8dab-da25358d04d7 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:26:12 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:26:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-40d84db8-8e39-48d3-8dab-da25358d04d7 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:12 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-40d84db8-8e39-48d3-8dab-da25358d04d7 1073741824 Sep 17 07:26:12 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:13 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-40d84db8-8e39-48d3-8dab-da25358d04d7 1073741824" returned: 0 in 0.586s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-40d84db8-8e39-48d3-8dab-da25358d04d7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:13 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-40d84db8-8e39-48d3-8dab-da25358d04d7 Sep 17 07:26:13 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:13 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-40d84db8-8e39-48d3-8dab-da25358d04d7" returned: 0 in 0.389s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:13 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:26:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:13 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f361c0-0991-4b30-bda7-8d8f3492d2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d84db8-8e39-48d3-8dab-da25358d04d7', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a5bb1f-067b-4ee0-b02b-6884d535e5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:14 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Volume volume-40d84db8-8e39-48d3-8dab-da25358d04d7 (40d84db8-8e39-48d3-8dab-da25358d04d7): created successfully Sep 17 07:26:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a5bb1f-067b-4ee0-b02b-6884d535e5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Flow 'volume_create_manager' (976a9781-1a42-46f5-b80c-27843e371dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:14 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cb3f8b9c-ef8a-4576-8221-2db1b601e675 tempest-VolumesActionsTest-799470292 None] Created volume successfully. Sep 17 07:26:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Acquiring lock "cinder-40d84db8-8e39-48d3-8dab-da25358d04d7-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Lock "cinder-40d84db8-8e39-48d3-8dab-da25358d04d7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Acquiring lock "cinder-quobyte-40d84db8-8e39-48d3-8dab-da25358d04d7" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Lock "cinder-quobyte-40d84db8-8e39-48d3-8dab-da25358d04d7" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:15 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2041ac8e-cc4b-4ec2-9073-c9f3d60acc72]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:26:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-40d84db8-8e39-48d3-8dab-da25358d04d7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:15 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-40d84db8-8e39-48d3-8dab-da25358d04d7 Sep 17 07:26:15 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:15 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-40d84db8-8e39-48d3-8dab-da25358d04d7" returned: 0 in 0.561s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-40d84db8-8e39-48d3-8dab-da25358d04d7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:15 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-40d84db8-8e39-48d3-8dab-da25358d04d7 Sep 17 07:26:15 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:16 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-40d84db8-8e39-48d3-8dab-da25358d04d7" returned: 0 in 0.328s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Lock "cinder-quobyte-40d84db8-8e39-48d3-8dab-da25358d04d7" released by "delete_volume" :: held 0.955s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Created reservations ['cd4dc236-2735-4cae-8c52-e7c1a309dbcb', '7e85d408-fa00-4ac7-9564-530fd67390ee', 'fd38e97b-9ec4-4489-97d5-622301f8a71d', 'afc37b49-8869-421e-9ea0-7c1cca4704ad'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:16 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:26:16 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Flow 'volume_create_manager' (19a3cb7f-2730-47d2-ac3f-fabc328e37ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e77ee42-c480-4728-b669-026156bb85eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e77ee42-c480-4728-b669-026156bb85eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1753807802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977187b5-17a6-48c4-9dae-80eb41554e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8500d88b854377bc5af9a3e26685f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:17Z,use_quota=True,user_id='fa665fabd84c4fa2bd326a4b77f3b10c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9af57245-12ca-4b35-9381-3d22077989fa),volume_type_id=9af57245-12ca-4b35-9381-3d22077989fa)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c76a39d-1315-4076-a332-7390b35a49e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c76a39d-1315-4076-a332-7390b35a49e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e550a1-c211-4d41-ad28-0fc95dbfd4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e550a1-c211-4d41-ad28-0fc95dbfd4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '977187b5-17a6-48c4-9dae-80eb41554e69', 'volume_name': 'volume-977187b5-17a6-48c4-9dae-80eb41554e69', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206a3f4b-f14b-4789-95db-7b54eadd71f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:16 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206a3f4b-f14b-4789-95db-7b54eadd71f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f599d23-56e8-46f9-b28f-3a8d530e2681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:16 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Volume 977187b5-17a6-48c4-9dae-80eb41554e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-977187b5-17a6-48c4-9dae-80eb41554e69', 'volume_size': 1} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1753807802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977187b5-17a6-48c4-9dae-80eb41554e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8500d88b854377bc5af9a3e26685f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:17Z,use_quota=True,user_id='fa665fabd84c4fa2bd326a4b77f3b10c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9af57245-12ca-4b35-9381-3d22077989fa),volume_type_id=9af57245-12ca-4b35-9381-3d22077989fa)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Creating volume 977187b5-17a6-48c4-9dae-80eb41554e69 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:26:16 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-977187b5-17a6-48c4-9dae-80eb41554e69 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.418s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:26:16 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-977187b5-17a6-48c4-9dae-80eb41554e69 1073741824 Sep 17 07:26:16 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Deleted volume successfully. Sep 17 07:26:16 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d2c66d4c-71ad-452c-8e36-b27b766b7d0e tempest-VolumesActionsTest-1554546313 None] Lock "cinder-40d84db8-8e39-48d3-8dab-da25358d04d7-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:17 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-977187b5-17a6-48c4-9dae-80eb41554e69 1073741824" returned: 0 in 0.573s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-977187b5-17a6-48c4-9dae-80eb41554e69 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:17 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-977187b5-17a6-48c4-9dae-80eb41554e69 Sep 17 07:26:17 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:17 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-977187b5-17a6-48c4-9dae-80eb41554e69" returned: 0 in 0.426s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:26:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f599d23-56e8-46f9-b28f-3a8d530e2681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-977187b5-17a6-48c4-9dae-80eb41554e69', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde89f13-c00c-4247-bd9f-ee0695702e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:17 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Volume volume-977187b5-17a6-48c4-9dae-80eb41554e69 (977187b5-17a6-48c4-9dae-80eb41554e69): created successfully Sep 17 07:26:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde89f13-c00c-4247-bd9f-ee0695702e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Flow 'volume_create_manager' (19a3cb7f-2730-47d2-ac3f-fabc328e37ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:17 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b15216a7-6dfe-4080-bf8e-ea3ee73e8793 tempest-VolumeTypesAccessTest-1628092848 None] Created volume successfully. Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Flow 'volume_create_manager' (46fc4d8d-6934-4302-83cf-17fa47ce892d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0fae65-eb15-45b6-bbe1-1b6db4a6aa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0fae65-eb15-45b6-bbe1-1b6db4a6aa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-780773843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3fe460-6f33-40bd-9075-727c45860360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4401c4fa2bd147809f85bc3749586600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:18Z,use_quota=True,user_id='174bfa5535fa4b60b280d169c4593001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c60b09a-7ab8-4f98-8fb2-e67dfaa8df1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c60b09a-7ab8-4f98-8fb2-e67dfaa8df1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb9f605-dea4-4bf3-ad31-bd801681edd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb9f605-dea4-4bf3-ad31-bd801681edd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f3fe460-6f33-40bd-9075-727c45860360', 'volume_name': 'volume-6f3fe460-6f33-40bd-9075-727c45860360', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b787bcf-a975-4cb5-8cb7-26337493eaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b787bcf-a975-4cb5-8cb7-26337493eaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3f2297-67ee-4569-a583-8c35f3f80af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:18 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Volume 6f3fe460-6f33-40bd-9075-727c45860360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f3fe460-6f33-40bd-9075-727c45860360', 'volume_size': 1} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-780773843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3fe460-6f33-40bd-9075-727c45860360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4401c4fa2bd147809f85bc3749586600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:18Z,use_quota=True,user_id='174bfa5535fa4b60b280d169c4593001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Creating volume 6f3fe460-6f33-40bd-9075-727c45860360 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:26:18 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6f3fe460-6f33-40bd-9075-727c45860360 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:18 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6f3fe460-6f33-40bd-9075-727c45860360 1073741824 Sep 17 07:26:18 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:18 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6f3fe460-6f33-40bd-9075-727c45860360 1073741824" returned: 0 in 0.622s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:18 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Flow 'volume_create_manager' (c8c7a5e7-0a19-4c16-9004-2601a1482246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1675096e-73d0-4e98-b680-69b987cc911e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1675096e-73d0-4e98-b680-69b987cc911e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-553471216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a8a1e3-c33f-46a9-b65b-63b94d47d3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ceecc1a1fd4ee68a65e52b4f99ee3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:19Z,use_quota=True,user_id='3aed56310b524794a01bdc721d30dc76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448c6a5e-5b10-434c-b2cf-af65985f5653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448c6a5e-5b10-434c-b2cf-af65985f5653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bd1256-ea77-4317-97b8-cd91b9f96028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bd1256-ea77-4317-97b8-cd91b9f96028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a8a1e3-c33f-46a9-b65b-63b94d47d3d0', 'volume_name': 'volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b84dc26-77c8-448e-b94e-5065b9c6e9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b84dc26-77c8-448e-b94e-5065b9c6e9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350a0f19-3d13-4adc-9ba3-fbbbd1dca47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:19 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Volume 70a8a1e3-c33f-46a9-b65b-63b94d47d3d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0', 'volume_size': 1} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Acquiring lock "cinder-977187b5-17a6-48c4-9dae-80eb41554e69-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Lock "cinder-977187b5-17a6-48c4-9dae-80eb41554e69-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6f3fe460-6f33-40bd-9075-727c45860360 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:19 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6f3fe460-6f33-40bd-9075-727c45860360 Sep 17 07:26:19 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Acquiring lock "cinder-quobyte-977187b5-17a6-48c4-9dae-80eb41554e69" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Lock "cinder-quobyte-977187b5-17a6-48c4-9dae-80eb41554e69" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1ff4ee-05a1-4593-a1ac-5171d4873338]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-977187b5-17a6-48c4-9dae-80eb41554e69 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:19 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-977187b5-17a6-48c4-9dae-80eb41554e69 Sep 17 07:26:19 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:19 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6f3fe460-6f33-40bd-9075-727c45860360" returned: 0 in 0.292s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.337s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-553471216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a8a1e3-c33f-46a9-b65b-63b94d47d3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ceecc1a1fd4ee68a65e52b4f99ee3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:19Z,use_quota=True,user_id='3aed56310b524794a01bdc721d30dc76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Creating volume 70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:26:19 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:19 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 1073741824 Sep 17 07:26:19 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3f2297-67ee-4569-a583-8c35f3f80af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3fe460-6f33-40bd-9075-727c45860360', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7106fc7e-7dff-41ba-af82-8c28b99d5e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:19 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Volume volume-6f3fe460-6f33-40bd-9075-727c45860360 (6f3fe460-6f33-40bd-9075-727c45860360): created successfully Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7106fc7e-7dff-41ba-af82-8c28b99d5e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Flow 'volume_create_manager' (46fc4d8d-6934-4302-83cf-17fa47ce892d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:19 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b32554cc-0042-4c3e-b205-513fbb2828e9 tempest-VolumesActionsTest-799470292 None] Created volume successfully. Sep 17 07:26:19 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-977187b5-17a6-48c4-9dae-80eb41554e69" returned: 0 in 0.384s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-977187b5-17a6-48c4-9dae-80eb41554e69 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:19 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-977187b5-17a6-48c4-9dae-80eb41554e69 Sep 17 07:26:19 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:19 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-977187b5-17a6-48c4-9dae-80eb41554e69" returned: 0 in 0.301s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Lock "cinder-quobyte-977187b5-17a6-48c4-9dae-80eb41554e69" released by "delete_volume" :: held 0.735s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:20 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 1073741824" returned: 0 in 0.509s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:20 devstack cinder-volume[86029]: WARNING cinder.quota [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-64005889 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-64005889, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:26:20 devstack cinder-volume[86029]: WARNING cinder.quota [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-64005889 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-64005889, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Created reservations ['56036e2e-9cfd-4ea4-9659-48f334c8119a', 'f5e11959-5ed3-40ba-8de0-458666a8d17f', '15c36b37-5407-4e8e-b41f-4f26a28b38e6', 'bc8bd90c-5818-4f24-a9f0-43bd682f5509'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:26:20 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 Sep 17 07:26:20 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:20 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:26:20 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:20 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0" returned: 0 in 0.360s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350a0f19-3d13-4adc-9ba3-fbbbd1dca47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6a989c-f346-4501-909f-a714920526d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:20 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:20 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Volume volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 (70a8a1e3-c33f-46a9-b65b-63b94d47d3d0): created successfully Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6a989c-f346-4501-909f-a714920526d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Flow 'volume_create_manager' (c8c7a5e7-0a19-4c16-9004-2601a1482246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.336s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:26:20 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Deleted volume successfully. Sep 17 07:26:20 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a736f874-768c-4e89-8494-52431607a629 tempest-TestImageHashVerification-1939026628 None] Created volume successfully. Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b74dfad-810e-4069-951b-e58b924a19f5 tempest-VolumeTypesAccessTest-1628092848 None] Lock "cinder-977187b5-17a6-48c4-9dae-80eb41554e69-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Acquiring lock "cinder-6f3fe460-6f33-40bd-9075-727c45860360-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Lock "cinder-6f3fe460-6f33-40bd-9075-727c45860360-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Acquiring lock "cinder-quobyte-6f3fe460-6f33-40bd-9075-727c45860360" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Lock "cinder-quobyte-6f3fe460-6f33-40bd-9075-727c45860360" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa2a99d-4961-442a-a96c-cc3c3d7a7f6e]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:26:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6f3fe460-6f33-40bd-9075-727c45860360 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:20 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6f3fe460-6f33-40bd-9075-727c45860360 Sep 17 07:26:20 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:21 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6f3fe460-6f33-40bd-9075-727c45860360" returned: 0 in 0.472s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6f3fe460-6f33-40bd-9075-727c45860360 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:21 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6f3fe460-6f33-40bd-9075-727c45860360 Sep 17 07:26:21 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:21 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6f3fe460-6f33-40bd-9075-727c45860360" returned: 0 in 0.315s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Lock "cinder-quobyte-6f3fe460-6f33-40bd-9075-727c45860360" released by "delete_volume" :: held 0.835s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:21 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Created reservations ['83f35630-d7b0-43a8-b352-412b8ef3645f', '47ef3e51-560c-4242-9746-18de0dc528ed', 'fd68b214-f085-494f-9eea-801291b16692', '0c646933-543e-464c-a990-14935abaca84'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:26:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:21 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:26:21 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:22 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.348s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:26:22 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Deleted volume successfully. Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ca360717-90db-4ad5-95c9-e52981c1cb70 tempest-VolumesActionsTest-1554546313 None] Lock "cinder-6f3fe460-6f33-40bd-9075-727c45860360-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Flow 'volume_create_manager' (b83c5958-ee3b-475b-9ee9-e5660f1777f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d6081f-24f7-43ae-b543-dccfe864ac0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d6081f-24f7-43ae-b543-dccfe864ac0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-370954062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3787905c-93e0-4d25-8406-ec15ac92ce1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4401c4fa2bd147809f85bc3749586600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:22Z,use_quota=True,user_id='174bfa5535fa4b60b280d169c4593001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7536e435-12f8-4d2f-9246-f1ef83c41879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7536e435-12f8-4d2f-9246-f1ef83c41879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940898e1-f783-4842-8211-0cdc553a7174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940898e1-f783-4842-8211-0cdc553a7174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3787905c-93e0-4d25-8406-ec15ac92ce1f', 'volume_name': 'volume-3787905c-93e0-4d25-8406-ec15ac92ce1f', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85a2d69-9349-46c5-89e0-8b96785e0540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85a2d69-9349-46c5-89e0-8b96785e0540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379c282c-b008-4adf-9e2f-129acbaed347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:22 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Volume 3787905c-93e0-4d25-8406-ec15ac92ce1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3787905c-93e0-4d25-8406-ec15ac92ce1f', 'volume_size': 1} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[49da8092-02ab-47e2-8276-95d2f9431a42]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:26:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:22 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 Sep 17 07:26:22 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:23 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0" returned: 0 in 0.399s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:23 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f4b29d-85a0-4beb-a989-c5bfd21f6eba]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:26:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:23 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 Sep 17 07:26:23 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:23 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-5b82c0a1-2aa6-412c-9334-27738f7084de tempest-GroupsTest-453854913 None] Group tempest-Group1-1877897358: creating Sep 17 07:26:23 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-5b82c0a1-2aa6-412c-9334-27738f7084de tempest-GroupsTest-453854913 None] Group tempest-Group1-1877897358: created successfully Sep 17 07:26:23 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-5b82c0a1-2aa6-412c-9334-27738f7084de tempest-GroupsTest-453854913 None] Create group completed successfully. Sep 17 07:26:23 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0" returned: 0 in 0.417s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 /opt/stack/data/cinder/conversion/70a8a1e3-c33f-46a9-b65b-63b94d47d3d0.temp_image.b65b16c8-0ce0-4738-a3ab-39aa3b6c285dwndigf0b.img {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:23 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 /opt/stack/data/cinder/conversion/70a8a1e3-c33f-46a9-b65b-63b94d47d3d0.temp_image.b65b16c8-0ce0-4738-a3ab-39aa3b6c285dwndigf0b.img Sep 17 07:26:23 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:24 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-f65e5547-0d7a-4c53-aea5-bcc6ae295efb tempest-GroupsTest-453854913 None] Group tempest-Group2-2054400464: creating Sep 17 07:26:24 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-f65e5547-0d7a-4c53-aea5-bcc6ae295efb tempest-GroupsTest-453854913 None] Group tempest-Group2-2054400464: created successfully Sep 17 07:26:24 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-f65e5547-0d7a-4c53-aea5-bcc6ae295efb tempest-GroupsTest-453854913 None] Create group completed successfully. Sep 17 07:26:26 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:26:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Flow 'volume_create_manager' (668d489e-0d3b-41c4-a023-4dd2ecdd8a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9f5634-5cfa-4a1c-9747-20e6a13831d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:27 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9f5634-5cfa-4a1c-9747-20e6a13831d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1046206949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d356958-9123-472f-861f-9a347da12451,host='devstack@QuobyteHD#QuobyteHD',id=3bfb3c65-b332-453c-b6a3-c9b647692a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172c658df633437f9f16da1842074563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:27Z,use_quota=True,user_id='7d9bda9732c5402fa0486370f4282e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdf36470-aa74-4c0a-8e6f-21b9cb302fa6),volume_type_id=bdf36470-aa74-4c0a-8e6f-21b9cb302fa6)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:27 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0d9cf2-629c-4091-ab7f-4dd92b42ee2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:27 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0d9cf2-629c-4091-ab7f-4dd92b42ee2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:27 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7908bea-6347-4df2-9637-700fd2c4b71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:27 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7908bea-6347-4df2-9637-700fd2c4b71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bfb3c65-b332-453c-b6a3-c9b647692a05', 'volume_name': 'volume-3bfb3c65-b332-453c-b6a3-c9b647692a05', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:27 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea97a4b9-eb29-4340-974a-d3747293da42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:27 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea97a4b9-eb29-4340-974a-d3747293da42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:27 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debc38fd-eafa-4f60-bfe5-857682cb5142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:27 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Volume 3bfb3c65-b332-453c-b6a3-c9b647692a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bfb3c65-b332-453c-b6a3-c9b647692a05', 'volume_size': 1} Sep 17 07:26:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:30 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 /opt/stack/data/cinder/conversion/70a8a1e3-c33f-46a9-b65b-63b94d47d3d0.temp_image.b65b16c8-0ce0-4738-a3ab-39aa3b6c285dwndigf0b.img" returned: 0 in 7.492s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:31 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61e41be-37b4-4500-a427-d67fcc4cdc73]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:26:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:31 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 Sep 17 07:26:31 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:31 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0" returned: 0 in 0.565s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:31 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/conversion/70a8a1e3-c33f-46a9-b65b-63b94d47d3d0.temp_image.b65b16c8-0ce0-4738-a3ab-39aa3b6c285dwndigf0b.img {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:26:31 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] Converted 1024.00 MB image at 136.65 MB/s Sep 17 07:26:31 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] b65b16c8-0ce0-4738-a3ab-39aa3b6c285d was raw, no need to convert to raw {{(pid=86029) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 17 07:26:37 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=93,cinder:UPDATE=111,cinder:INSERT=24,cinder:DELETE=10 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:26:37 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:UPDATE=108,cinder:SELECT=113,cinder:INSERT=24,cinder:DELETE=4 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:26:37 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:26:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Flow 'volume_create_manager' (3c0c18ac-32d5-4788-8602-98786c77518c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d4d064-2262-4924-a4a8-bfcead29408c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d4d064-2262-4924-a4a8-bfcead29408c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1458375396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1760b2ea-d4e1-4503-add5-e514a4ad3feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bba0d64a9d14a689dbd83bb7f57cc67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:37Z,use_quota=True,user_id='674c2486d7f14a9aa73b1e31f03ec559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44f0005-2605-4746-8f77-00c06f9b2e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44f0005-2605-4746-8f77-00c06f9b2e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63da893c-c0ce-45a6-a611-decdf32e7850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63da893c-c0ce-45a6-a611-decdf32e7850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1760b2ea-d4e1-4503-add5-e514a4ad3feb', 'volume_name': 'volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff0c279-c69d-41a1-a5b7-4e725561190c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff0c279-c69d-41a1-a5b7-4e725561190c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35a0cda-4192-430b-ba35-a94d2c299cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:37 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Volume 1760b2ea-d4e1-4503-add5-e514a4ad3feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb', 'volume_size': 1} Sep 17 07:26:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:47 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=1 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:26:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.032s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] Uploaded volume to glance image-id: b65b16c8-0ce0-4738-a3ab-39aa3b6c285d. {{(pid=86029) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 07:26:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.974s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-370954062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3787905c-93e0-4d25-8406-ec15ac92ce1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4401c4fa2bd147809f85bc3749586600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:22Z,use_quota=True,user_id='174bfa5535fa4b60b280d169c4593001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:26:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Creating volume 3787905c-93e0-4d25-8406-ec15ac92ce1f {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:26:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:26:51 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:26:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3787905c-93e0-4d25-8406-ec15ac92ce1f 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:51 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3787905c-93e0-4d25-8406-ec15ac92ce1f 1073741824 Sep 17 07:26:51 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:51 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3d5ff961-49b0-470b-aec1-396ac3aa0179 tempest-TestImageHashVerification-1939026628 None] Copy volume to image completed successfully. Sep 17 07:26:52 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3787905c-93e0-4d25-8406-ec15ac92ce1f 1073741824" returned: 0 in 0.417s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3787905c-93e0-4d25-8406-ec15ac92ce1f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:52 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3787905c-93e0-4d25-8406-ec15ac92ce1f Sep 17 07:26:52 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:52 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3787905c-93e0-4d25-8406-ec15ac92ce1f" returned: 0 in 0.264s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.298s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2d356958-9123-472f-861f-9a347da12451,created_at=2026-09-17T05:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1046206949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d356958-9123-472f-861f-9a347da12451,host='devstack@QuobyteHD#QuobyteHD',id=3bfb3c65-b332-453c-b6a3-c9b647692a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172c658df633437f9f16da1842074563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:27Z,use_quota=True,user_id='7d9bda9732c5402fa0486370f4282e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdf36470-aa74-4c0a-8e6f-21b9cb302fa6),volume_type_id=bdf36470-aa74-4c0a-8e6f-21b9cb302fa6)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Creating volume 3bfb3c65-b332-453c-b6a3-c9b647692a05 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:26:52 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3bfb3c65-b332-453c-b6a3-c9b647692a05 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379c282c-b008-4adf-9e2f-129acbaed347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3787905c-93e0-4d25-8406-ec15ac92ce1f', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:52 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3bfb3c65-b332-453c-b6a3-c9b647692a05 1073741824 Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be327df-b171-41a2-b1c5-465e8a69cbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:52 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:52 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Volume volume-3787905c-93e0-4d25-8406-ec15ac92ce1f (3787905c-93e0-4d25-8406-ec15ac92ce1f): created successfully Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be327df-b171-41a2-b1c5-465e8a69cbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Flow 'volume_create_manager' (b83c5958-ee3b-475b-9ee9-e5660f1777f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:52 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-89287133-6a9c-4729-87ec-4aeefdfdc2ae tempest-VolumesActionsTest-799470292 None] Created volume successfully. Sep 17 07:26:52 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3bfb3c65-b332-453c-b6a3-c9b647692a05 1073741824" returned: 0 in 0.462s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Acquiring lock "cinder-3787905c-93e0-4d25-8406-ec15ac92ce1f-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3bfb3c65-b332-453c-b6a3-c9b647692a05 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Lock "cinder-3787905c-93e0-4d25-8406-ec15ac92ce1f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:52 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3bfb3c65-b332-453c-b6a3-c9b647692a05 Sep 17 07:26:52 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Acquiring lock "cinder-quobyte-3787905c-93e0-4d25-8406-ec15ac92ce1f" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Lock "cinder-quobyte-3787905c-93e0-4d25-8406-ec15ac92ce1f" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea510bba-1a2e-4aaa-9a87-b2ff04b5e1fd]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3787905c-93e0-4d25-8406-ec15ac92ce1f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:53 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3787905c-93e0-4d25-8406-ec15ac92ce1f Sep 17 07:26:53 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:53 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3bfb3c65-b332-453c-b6a3-c9b647692a05" returned: 0 in 0.282s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.543s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1458375396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1760b2ea-d4e1-4503-add5-e514a4ad3feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bba0d64a9d14a689dbd83bb7f57cc67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:37Z,use_quota=True,user_id='674c2486d7f14a9aa73b1e31f03ec559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Creating volume 1760b2ea-d4e1-4503-add5-e514a4ad3feb {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:26:53 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debc38fd-eafa-4f60-bfe5-857682cb5142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bfb3c65-b332-453c-b6a3-c9b647692a05', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:53 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb 1073741824 Sep 17 07:26:53 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a25bb40-6586-4810-b380-c13c71f07188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:53 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Volume volume-3bfb3c65-b332-453c-b6a3-c9b647692a05 (3bfb3c65-b332-453c-b6a3-c9b647692a05): created successfully Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a25bb40-6586-4810-b380-c13c71f07188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Flow 'volume_create_manager' (668d489e-0d3b-41c4-a023-4dd2ecdd8a83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:53 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-012ce890-f499-4e37-ac9b-ce3b2b49d731 tempest-GroupsTest-453854913 None] Created volume successfully. Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Acquiring lock "cinder-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Lock "cinder-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Acquiring lock "cinder-quobyte-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Lock "cinder-quobyte-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:53 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3787905c-93e0-4d25-8406-ec15ac92ce1f" returned: 0 in 0.483s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3787905c-93e0-4d25-8406-ec15ac92ce1f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fcc310-da32-460b-8034-b59db5c98f0f]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:53 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3787905c-93e0-4d25-8406-ec15ac92ce1f Sep 17 07:26:53 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:53 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 Sep 17 07:26:53 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:53 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb 1073741824" returned: 0 in 0.501s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:53 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3787905c-93e0-4d25-8406-ec15ac92ce1f" returned: 0 in 0.270s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:53 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb Sep 17 07:26:53 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Lock "cinder-quobyte-3787905c-93e0-4d25-8406-ec15ac92ce1f" released by "delete_volume" :: held 0.806s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Created reservations ['a10df490-de35-4ddc-9075-b1e8d6f0235c', 'af19cb14-052b-4ed3-ab9c-d3307521d390', 'a875305e-c479-4a0a-aa2a-197aed4782f8', '033b7f4e-b6c7-405f-91fd-f071d0f2dc67'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:53 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0" returned: 0 in 0.405s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:53 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:26:53 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:53 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0 Sep 17 07:26:53 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:54 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb" returned: 0 in 0.279s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35a0cda-4192-430b-ba35-a94d2c299cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755e4642-69ad-4768-99b1-b11ba272e25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:54 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Volume volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb (1760b2ea-d4e1-4503-add5-e514a4ad3feb): created successfully Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755e4642-69ad-4768-99b1-b11ba272e25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Flow 'volume_create_manager' (3c0c18ac-32d5-4788-8602-98786c77518c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:54 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-7a4f56fd-b95c-4a3c-b724-a7f09ce4e65e tempest-VolumesListAdminTestJSON-846756617 None] Created volume successfully. Sep 17 07:26:54 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.292s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:26:54 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Deleted volume successfully. Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-83be0131-81d9-49ee-ae5a-cdcc13e0692d tempest-VolumesActionsTest-1554546313 None] Lock "cinder-3787905c-93e0-4d25-8406-ec15ac92ce1f-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:54 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0" returned: 0 in 0.323s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Lock "cinder-quobyte-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0" released by "delete_volume" :: held 0.786s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Created reservations ['f3ae3d24-2aef-449d-b9d7-2ddef8965fb1', '32c7281e-0dd0-4adf-9f57-f375a368a306', '4060ab0e-feaa-4b0f-a314-9641ea5bad1e', 'cc89c334-218a-4c2c-96ca-4b5d7834c151'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:54 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:26:54 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:26:54 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Flow 'volume_create_manager' (757c8f90-6509-448c-95dd-a15ff49c8b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76af65f9-f36c-4c64-85dc-015639a37aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.373s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:26:54 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Deleted volume successfully. Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76af65f9-f36c-4c64-85dc-015639a37aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1958580681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f012106b-4dda-4b2e-b4d0-6a8928f42f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4401c4fa2bd147809f85bc3749586600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:55Z,use_quota=True,user_id='174bfa5535fa4b60b280d169c4593001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e81cd84-1141-45b1-ad73-60119385c26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e81cd84-1141-45b1-ad73-60119385c26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b178e7-fa7f-4027-8431-d6231ae57067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b178e7-fa7f-4027-8431-d6231ae57067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f012106b-4dda-4b2e-b4d0-6a8928f42f7e', 'volume_name': 'volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a62b03b2-6ac2-4dab-b6ba-3193c302952b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a62b03b2-6ac2-4dab-b6ba-3193c302952b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f531dba-cecc-4c53-b1b0-e9c367df296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:54 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Volume f012106b-4dda-4b2e-b4d0-6a8928f42f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e', 'volume_size': 1} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1958580681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f012106b-4dda-4b2e-b4d0-6a8928f42f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4401c4fa2bd147809f85bc3749586600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:55Z,use_quota=True,user_id='174bfa5535fa4b60b280d169c4593001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Creating volume f012106b-4dda-4b2e-b4d0-6a8928f42f7e {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:26:54 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-fb3426f5-895b-45aa-8017-d9c83c295eda tempest-TestImageHashVerification-1939026628 None] Lock "cinder-70a8a1e3-c33f-46a9-b65b-63b94d47d3d0-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:54 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e 1073741824 Sep 17 07:26:54 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Acquiring lock "cinder-quobyte-3bfb3c65-b332-453c-b6a3-c9b647692a05" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Lock "cinder-quobyte-3bfb3c65-b332-453c-b6a3-c9b647692a05" acquired by "delete_volume" :: waited 0.036s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a100f1-579a-420e-b32b-75968a0032b1]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3bfb3c65-b332-453c-b6a3-c9b647692a05 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:55 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3bfb3c65-b332-453c-b6a3-c9b647692a05 Sep 17 07:26:55 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Flow 'volume_create_manager' (4bbf6613-a7a4-4ac8-b653-c16128bd1020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:55 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7ca6ed-9228-4054-abd4-dbe4aec9a7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e 1073741824" returned: 0 in 0.669s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7ca6ed-9228-4054-abd4-dbe4aec9a7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1817474124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d53299-a2bd-40b1-9a44-c51e79799371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bba0d64a9d14a689dbd83bb7f57cc67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:55Z,use_quota=True,user_id='674c2486d7f14a9aa73b1e31f03ec559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75cbb83-1539-406d-a8f0-25a58b678b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75cbb83-1539-406d-a8f0-25a58b678b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd0ecd0-1ba1-4e5e-ad49-d2bb97727e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd0ecd0-1ba1-4e5e-ad49-d2bb97727e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8d53299-a2bd-40b1-9a44-c51e79799371', 'volume_name': 'volume-b8d53299-a2bd-40b1-9a44-c51e79799371', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ea9d37-bb6f-4897-999a-ba64df22624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ea9d37-bb6f-4897-999a-ba64df22624b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20900b0e-c752-4b18-aba5-2a26f569b7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:55 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Volume b8d53299-a2bd-40b1-9a44-c51e79799371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8d53299-a2bd-40b1-9a44-c51e79799371', 'volume_size': 1} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:55 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e Sep 17 07:26:55 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:55 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3bfb3c65-b332-453c-b6a3-c9b647692a05" returned: 0 in 0.526s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3bfb3c65-b332-453c-b6a3-c9b647692a05 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:55 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3bfb3c65-b332-453c-b6a3-c9b647692a05 Sep 17 07:26:55 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:55 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e" returned: 0 in 0.267s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.297s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1817474124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d53299-a2bd-40b1-9a44-c51e79799371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bba0d64a9d14a689dbd83bb7f57cc67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:55Z,use_quota=True,user_id='674c2486d7f14a9aa73b1e31f03ec559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Creating volume b8d53299-a2bd-40b1-9a44-c51e79799371 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:26:55 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8d53299-a2bd-40b1-9a44-c51e79799371 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f531dba-cecc-4c53-b1b0-e9c367df296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa7ce69-9bcc-4ec4-82bf-008536517b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:55 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8d53299-a2bd-40b1-9a44-c51e79799371 1073741824 Sep 17 07:26:55 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:55 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Volume volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e (f012106b-4dda-4b2e-b4d0-6a8928f42f7e): created successfully Sep 17 07:26:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa7ce69-9bcc-4ec4-82bf-008536517b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Flow 'volume_create_manager' (757c8f90-6509-448c-95dd-a15ff49c8b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:56 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8def0de7-9f43-4bc3-9dc0-66a4b42ad198 tempest-VolumesActionsTest-799470292 None] Created volume successfully. Sep 17 07:26:56 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3bfb3c65-b332-453c-b6a3-c9b647692a05" returned: 0 in 0.276s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Lock "cinder-quobyte-3bfb3c65-b332-453c-b6a3-c9b647692a05" released by "delete_volume" :: held 0.878s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Created reservations ['023bcc68-e212-47bc-8286-bf48be727f13'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:26:56 devstack cinder-volume[86029]: WARNING cinder.quota [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1661827779 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1661827779, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:26:56 devstack cinder-volume[86029]: WARNING cinder.quota [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1661827779 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1661827779, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Created reservations ['5eec45c6-7869-4ded-bfca-ca01b809936a', '88975c07-ae9a-4203-8f51-169b4c25a425', '7b3d782b-810a-4322-88a9-b7b10f55e1b1', 'cda04c7c-fb47-467d-8cd1-767c4a625d33'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:56 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:26:56 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-e8386657-49af-4920-8705-77ff87a58ee1 tempest-GroupsTest-453854913 None] Created reservations ['56e00c3e-8ba5-4367-b689-7ed6c337aaee'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:26:56 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8d53299-a2bd-40b1-9a44-c51e79799371 1073741824" returned: 0 in 0.612s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e8386657-49af-4920-8705-77ff87a58ee1 tempest-GroupsTest-453854913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e8386657-49af-4920-8705-77ff87a58ee1 tempest-GroupsTest-453854913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e8386657-49af-4920-8705-77ff87a58ee1 tempest-GroupsTest-453854913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e8386657-49af-4920-8705-77ff87a58ee1 tempest-GroupsTest-453854913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e8386657-49af-4920-8705-77ff87a58ee1 tempest-GroupsTest-453854913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e8386657-49af-4920-8705-77ff87a58ee1 tempest-GroupsTest-453854913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8d53299-a2bd-40b1-9a44-c51e79799371 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:56 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:26:56 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:56 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.337s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:26:56 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-91104e2f-7ac6-41af-9e3c-8f03cb663ba3 tempest-GroupsTest-453854913 None] Delete group completed successfully. Sep 17 07:26:56 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8d53299-a2bd-40b1-9a44-c51e79799371 Sep 17 07:26:56 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:56 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e8386657-49af-4920-8705-77ff87a58ee1 tempest-GroupsTest-453854913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.289s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-e8386657-49af-4920-8705-77ff87a58ee1 tempest-GroupsTest-453854913 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:26:56 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e8386657-49af-4920-8705-77ff87a58ee1 tempest-GroupsTest-453854913 None] Delete group completed successfully. Sep 17 07:26:56 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8d53299-a2bd-40b1-9a44-c51e79799371" returned: 0 in 0.303s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20900b0e-c752-4b18-aba5-2a26f569b7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d53299-a2bd-40b1-9a44-c51e79799371', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768dc796-2a23-4c2e-8fcc-ca9d016efd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:56 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Volume volume-b8d53299-a2bd-40b1-9a44-c51e79799371 (b8d53299-a2bd-40b1-9a44-c51e79799371): created successfully Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768dc796-2a23-4c2e-8fcc-ca9d016efd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Flow 'volume_create_manager' (4bbf6613-a7a4-4ac8-b653-c16128bd1020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:56 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-c34b3ff0-aa83-4b93-969b-00dcdb7a42cc tempest-VolumesListAdminTestJSON-846756617 None] Created volume successfully. Sep 17 07:26:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Acquiring lock "cinder-f012106b-4dda-4b2e-b4d0-6a8928f42f7e-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Lock "cinder-f012106b-4dda-4b2e-b4d0-6a8928f42f7e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Acquiring lock "cinder-quobyte-f012106b-4dda-4b2e-b4d0-6a8928f42f7e" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:26:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Lock "cinder-quobyte-f012106b-4dda-4b2e-b4d0-6a8928f42f7e" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:26:57 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7408d98d-4650-4aaf-8ddc-5b6b75fa71bd]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:26:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:57 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e Sep 17 07:26:57 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:57 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e" returned: 0 in 0.448s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:57 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e Sep 17 07:26:57 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:57 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f012106b-4dda-4b2e-b4d0-6a8928f42f7e" returned: 0 in 0.323s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Lock "cinder-quobyte-f012106b-4dda-4b2e-b4d0-6a8928f42f7e" released by "delete_volume" :: held 0.828s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Created reservations ['a4c2b110-181f-4b69-8a94-34cc95e6563f', '5e1b423e-87b3-4715-964f-75a3b1739f50', 'a689dbc4-d26f-40a0-846e-c4ba06c0b9dc', '104f88ab-e2a1-469d-8e27-f982bec2007b'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Flow 'volume_create_manager' (8719ddad-ae63-4014-90a6-213af1fa9897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff2d4e3-5bf4-452e-92c5-3933b91efe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff2d4e3-5bf4-452e-92c5-3933b91efe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1261791283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93019237-de3d-4b4d-970c-50d474f59969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bba0d64a9d14a689dbd83bb7f57cc67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:58Z,use_quota=True,user_id='674c2486d7f14a9aa73b1e31f03ec559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d0470a-c4a1-42e8-91a6-18d96b5939b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d0470a-c4a1-42e8-91a6-18d96b5939b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f176d2-0c29-49c9-8604-dbe38fd4118b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f176d2-0c29-49c9-8604-dbe38fd4118b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93019237-de3d-4b4d-970c-50d474f59969', 'volume_name': 'volume-93019237-de3d-4b4d-970c-50d474f59969', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f72c6c-b864-484f-99dd-128b0368ea35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f72c6c-b864-484f-99dd-128b0368ea35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cc7696-d2ea-4b4b-9c33-97fe78c9ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:58 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Volume 93019237-de3d-4b4d-970c-50d474f59969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93019237-de3d-4b4d-970c-50d474f59969', 'volume_size': 1} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1261791283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93019237-de3d-4b4d-970c-50d474f59969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bba0d64a9d14a689dbd83bb7f57cc67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:58Z,use_quota=True,user_id='674c2486d7f14a9aa73b1e31f03ec559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Creating volume 93019237-de3d-4b4d-970c-50d474f59969 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:26:58 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-93019237-de3d-4b4d-970c-50d474f59969 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:58 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-93019237-de3d-4b4d-970c-50d474f59969 1073741824 Sep 17 07:26:58 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-bfb3032a-ebfe-4712-948f-03541eb86986 tempest-GroupsTest-453854913 None] Group tempest-GroupsTest-Group-1659999429: creating Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-bfb3032a-ebfe-4712-948f-03541eb86986 tempest-GroupsTest-453854913 None] Group tempest-GroupsTest-Group-1659999429: created successfully Sep 17 07:26:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-bfb3032a-ebfe-4712-948f-03541eb86986 tempest-GroupsTest-453854913 None] Create group completed successfully. Sep 17 07:26:58 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:26:58 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:58 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.375s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:26:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Deleted volume successfully. Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e8991eb3-8833-4c03-829e-2343952288b8 tempest-VolumesActionsTest-1554546313 None] Lock "cinder-f012106b-4dda-4b2e-b4d0-6a8928f42f7e-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:26:58 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-93019237-de3d-4b4d-970c-50d474f59969 1073741824" returned: 0 in 0.616s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-93019237-de3d-4b4d-970c-50d474f59969 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:58 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-93019237-de3d-4b4d-970c-50d474f59969 Sep 17 07:26:58 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Flow 'volume_create_manager' (ff61086e-d3a0-4138-812e-1e0c53b0b191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7b1146-e6ae-471c-9271-04557fc72910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7b1146-e6ae-471c-9271-04557fc72910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-396674807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d91f567-4271-4571-89fd-0b2d67afd9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4401c4fa2bd147809f85bc3749586600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:59Z,use_quota=True,user_id='174bfa5535fa4b60b280d169c4593001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb3330d-97d5-4c75-9744-e13339db45f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb3330d-97d5-4c75-9744-e13339db45f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5973a1a6-2324-48c2-a3e3-094bf101b2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5973a1a6-2324-48c2-a3e3-094bf101b2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d91f567-4271-4571-89fd-0b2d67afd9a6', 'volume_name': 'volume-7d91f567-4271-4571-89fd-0b2d67afd9a6', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabdab28-7b23-4128-ade3-32456b21fd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabdab28-7b23-4128-ade3-32456b21fd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81152a22-8b35-426a-9a45-c01e13aff4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:59 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Volume 7d91f567-4271-4571-89fd-0b2d67afd9a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d91f567-4271-4571-89fd-0b2d67afd9a6', 'volume_size': 1} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:59 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-93019237-de3d-4b4d-970c-50d474f59969" returned: 0 in 0.290s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.035s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-396674807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d91f567-4271-4571-89fd-0b2d67afd9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4401c4fa2bd147809f85bc3749586600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:26:59Z,use_quota=True,user_id='174bfa5535fa4b60b280d169c4593001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Creating volume 7d91f567-4271-4571-89fd-0b2d67afd9a6 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:26:59 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7d91f567-4271-4571-89fd-0b2d67afd9a6 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cc7696-d2ea-4b4b-9c33-97fe78c9ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93019237-de3d-4b4d-970c-50d474f59969', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603f7872-7a5e-400d-8db4-aa304ff61db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:26:59 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7d91f567-4271-4571-89fd-0b2d67afd9a6 1073741824 Sep 17 07:26:59 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:26:59 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Volume volume-93019237-de3d-4b4d-970c-50d474f59969 (93019237-de3d-4b4d-970c-50d474f59969): created successfully Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603f7872-7a5e-400d-8db4-aa304ff61db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Flow 'volume_create_manager' (8719ddad-ae63-4014-90a6-213af1fa9897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:26:59 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b9c2505d-46c1-4cd4-91ab-6ddbe2a51767 tempest-VolumesListAdminTestJSON-846756617 None] Created volume successfully. Sep 17 07:26:59 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7d91f567-4271-4571-89fd-0b2d67afd9a6 1073741824" returned: 0 in 0.606s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:26:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7d91f567-4271-4571-89fd-0b2d67afd9a6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:26:59 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7d91f567-4271-4571-89fd-0b2d67afd9a6 Sep 17 07:26:59 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Flow 'volume_create_manager' (3b038bd9-0555-434e-a95d-8434b2c27933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6aca20-6335-4fd5-8cae-353cc8d0dd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6aca20-6335-4fd5-8cae-353cc8d0dd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-402038226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1d85b34-ad15-43f7-a3a3-1362dd8b9757,host='devstack@QuobyteHD#QuobyteHD',id=a0fd04ea-f71e-42f0-919f-c63d2fc2b26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172c658df633437f9f16da1842074563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:00Z,use_quota=True,user_id='7d9bda9732c5402fa0486370f4282e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69e367ce-f01e-4924-9c94-4d9c319d1d65),volume_type_id=69e367ce-f01e-4924-9c94-4d9c319d1d65)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:00 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d700b755-ee59-425b-b8ab-17a3ab597ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d700b755-ee59-425b-b8ab-17a3ab597ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cd81e6-3415-43b0-81d1-e0d8e9621b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cd81e6-3415-43b0-81d1-e0d8e9621b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0fd04ea-f71e-42f0-919f-c63d2fc2b26b', 'volume_name': 'volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8f6ddd-c2f7-4591-b0cc-574957697725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8f6ddd-c2f7-4591-b0cc-574957697725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc83c4d-35b1-4ebd-ad39-6a8e4129e3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:00 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Volume a0fd04ea-f71e-42f0-919f-c63d2fc2b26b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b', 'volume_size': 1} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7d91f567-4271-4571-89fd-0b2d67afd9a6" returned: 0 in 0.350s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e1d85b34-ad15-43f7-a3a3-1362dd8b9757,created_at=2026-09-17T05:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-402038226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1d85b34-ad15-43f7-a3a3-1362dd8b9757,host='devstack@QuobyteHD#QuobyteHD',id=a0fd04ea-f71e-42f0-919f-c63d2fc2b26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172c658df633437f9f16da1842074563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:00Z,use_quota=True,user_id='7d9bda9732c5402fa0486370f4282e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69e367ce-f01e-4924-9c94-4d9c319d1d65),volume_type_id=69e367ce-f01e-4924-9c94-4d9c319d1d65)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Creating volume a0fd04ea-f71e-42f0-919f-c63d2fc2b26b {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:27:00 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81152a22-8b35-426a-9a45-c01e13aff4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d91f567-4271-4571-89fd-0b2d67afd9a6', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d8f504-08c3-4801-a73f-018f86ca601d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:00 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b 1073741824 Sep 17 07:27:00 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:00 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Volume volume-7d91f567-4271-4571-89fd-0b2d67afd9a6 (7d91f567-4271-4571-89fd-0b2d67afd9a6): created successfully Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d8f504-08c3-4801-a73f-018f86ca601d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Flow 'volume_create_manager' (ff61086e-d3a0-4138-812e-1e0c53b0b191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-264f5254-ce39-402a-8981-80df47c2523e tempest-VolumesActionsTest-799470292 None] Created volume successfully. Sep 17 07:27:00 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b 1073741824" returned: 0 in 0.531s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:00 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b Sep 17 07:27:00 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Flow 'volume_create_manager' (0cae92e9-a98a-4dd5-bcc2-f4188768295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78b9a53-dca6-46bc-a9e4-b694f5e310d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78b9a53-dca6-46bc-a9e4-b694f5e310d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161bb371-5062-4770-9325-cba49623be2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31dc31d3a23e4c1f80c654ff6f803760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:01Z,use_quota=True,user_id='90e4cbd855ce40eabc7e6c6451e804cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7fc29a-e48a-49f8-a31f-36fb079ec656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:01 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7fc29a-e48a-49f8-a31f-36fb079ec656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df71609-a095-4b88-bdf2-fe481eff07a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df71609-a095-4b88-bdf2-fe481eff07a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '161bb371-5062-4770-9325-cba49623be2b', 'volume_name': 'volume-161bb371-5062-4770-9325-cba49623be2b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7be9e3-814a-4721-ac50-fd015db9aaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7be9e3-814a-4721-ac50-fd015db9aaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235bef4a-f306-461b-ae9f-a8ee0592e53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:01 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Volume 161bb371-5062-4770-9325-cba49623be2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-161bb371-5062-4770-9325-cba49623be2b', 'volume_size': 1} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b" returned: 0 in 0.350s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161bb371-5062-4770-9325-cba49623be2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31dc31d3a23e4c1f80c654ff6f803760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:01Z,use_quota=True,user_id='90e4cbd855ce40eabc7e6c6451e804cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Creating volume 161bb371-5062-4770-9325-cba49623be2b {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:27:01 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-161bb371-5062-4770-9325-cba49623be2b 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc83c4d-35b1-4ebd-ad39-6a8e4129e3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3716cd74-418f-4bb8-b843-ae7695ddde54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:01 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-161bb371-5062-4770-9325-cba49623be2b 1073741824 Sep 17 07:27:01 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:01 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Volume volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b (a0fd04ea-f71e-42f0-919f-c63d2fc2b26b): created successfully Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3716cd74-418f-4bb8-b843-ae7695ddde54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Flow 'volume_create_manager' (3b038bd9-0555-434e-a95d-8434b2c27933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4d25a085-11b1-4fa2-9569-97ffee86d456 tempest-GroupsTest-453854913 None] Created volume successfully. Sep 17 07:27:01 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-161bb371-5062-4770-9325-cba49623be2b 1073741824" returned: 0 in 0.586s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-161bb371-5062-4770-9325-cba49623be2b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:01 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-161bb371-5062-4770-9325-cba49623be2b Sep 17 07:27:01 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Acquiring lock "cinder-7d91f567-4271-4571-89fd-0b2d67afd9a6-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Lock "cinder-7d91f567-4271-4571-89fd-0b2d67afd9a6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Acquiring lock "cinder-quobyte-7d91f567-4271-4571-89fd-0b2d67afd9a6" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Lock "cinder-quobyte-7d91f567-4271-4571-89fd-0b2d67afd9a6" acquired by "delete_volume" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ba3e42-df16-4c62-a9ff-f9f9cccffcb5]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7d91f567-4271-4571-89fd-0b2d67afd9a6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:02 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-161bb371-5062-4770-9325-cba49623be2b" returned: 0 in 0.297s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235bef4a-f306-461b-ae9f-a8ee0592e53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161bb371-5062-4770-9325-cba49623be2b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d056255b-3c4e-4687-a4c1-5675762680cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:02 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Volume volume-161bb371-5062-4770-9325-cba49623be2b (161bb371-5062-4770-9325-cba49623be2b): created successfully Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d056255b-3c4e-4687-a4c1-5675762680cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:02 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7d91f567-4271-4571-89fd-0b2d67afd9a6 Sep 17 07:27:02 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Flow 'volume_create_manager' (0cae92e9-a98a-4dd5-bcc2-f4188768295d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:02 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-afbcd9ea-93f2-49a7-812d-cdc19a434e8d tempest-VolumesListAdminTestJSON-792096976 None] Created volume successfully. Sep 17 07:27:02 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7d91f567-4271-4571-89fd-0b2d67afd9a6" returned: 0 in 0.434s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7d91f567-4271-4571-89fd-0b2d67afd9a6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:02 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7d91f567-4271-4571-89fd-0b2d67afd9a6 Sep 17 07:27:02 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:02 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7d91f567-4271-4571-89fd-0b2d67afd9a6" returned: 0 in 0.261s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Lock "cinder-quobyte-7d91f567-4271-4571-89fd-0b2d67afd9a6" released by "delete_volume" :: held 0.757s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Created reservations ['64f3c0f4-e28d-4019-8b1f-4b3c3eaf1e4b', 'e8803aef-5028-436e-b810-7a688bde2113', 'a6a2cd27-9920-4fd7-892b-c7a5c67e1982', 'd77f63a2-2536-4b85-b431-8ca232dd3742'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:02 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:27:02 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Flow 'volume_create_manager' (0a93249a-d9ad-40af-a88a-dc5a76588890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c1a4eb-6fd1-45bb-ad8e-fa6e90fd1eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c1a4eb-6fd1-45bb-ad8e-fa6e90fd1eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-891092164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1d85b34-ad15-43f7-a3a3-1362dd8b9757,host='devstack@QuobyteHD#QuobyteHD',id=bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172c658df633437f9f16da1842074563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:03Z,use_quota=True,user_id='7d9bda9732c5402fa0486370f4282e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69e367ce-f01e-4924-9c94-4d9c319d1d65),volume_type_id=69e367ce-f01e-4924-9c94-4d9c319d1d65)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdeeeef-2a38-423b-9d80-e05f181acf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdeeeef-2a38-423b-9d80-e05f181acf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c0f672-e23d-472b-9635-764096e57b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:03 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c0f672-e23d-472b-9635-764096e57b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8', 'volume_name': 'volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ae76a1-1d13-40bc-b8cb-7fa516c96fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ae76a1-1d13-40bc-b8cb-7fa516c96fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7dc5ec-1b03-4cb8-9e82-ef20b23a95f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:03 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Volume bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8', 'volume_size': 1} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e1d85b34-ad15-43f7-a3a3-1362dd8b9757,created_at=2026-09-17T05:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-891092164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1d85b34-ad15-43f7-a3a3-1362dd8b9757,host='devstack@QuobyteHD#QuobyteHD',id=bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172c658df633437f9f16da1842074563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:03Z,use_quota=True,user_id='7d9bda9732c5402fa0486370f4282e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69e367ce-f01e-4924-9c94-4d9c319d1d65),volume_type_id=69e367ce-f01e-4924-9c94-4d9c319d1d65)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Creating volume bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:27:03 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.419s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:27:03 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Deleted volume successfully. Sep 17 07:27:03 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8 1073741824 Sep 17 07:27:03 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-64ec124a-77ba-4dd3-bc8f-ed378405f876 tempest-VolumesActionsTest-799470292 None] Lock "cinder-7d91f567-4271-4571-89fd-0b2d67afd9a6-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Acquiring lock "cinder-161bb371-5062-4770-9325-cba49623be2b-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Lock "cinder-161bb371-5062-4770-9325-cba49623be2b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Acquiring lock "cinder-quobyte-161bb371-5062-4770-9325-cba49623be2b" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Lock "cinder-quobyte-161bb371-5062-4770-9325-cba49623be2b" acquired by "delete_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b786fe4-eaeb-4c85-b1f7-589ab3188a78]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-161bb371-5062-4770-9325-cba49623be2b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "cinder-93019237-de3d-4b4d-970c-50d474f59969-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Lock "cinder-93019237-de3d-4b4d-970c-50d474f59969-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:03 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-161bb371-5062-4770-9325-cba49623be2b Sep 17 07:27:03 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "cinder-quobyte-93019237-de3d-4b4d-970c-50d474f59969" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Lock "cinder-quobyte-93019237-de3d-4b4d-970c-50d474f59969" acquired by "delete_volume" :: waited 0.041s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:03 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae089247-dbd1-46ae-8cde-79879561a550]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-93019237-de3d-4b4d-970c-50d474f59969 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8 1073741824" returned: 0 in 0.699s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:03 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8 Sep 17 07:27:03 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:04 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-93019237-de3d-4b4d-970c-50d474f59969 Sep 17 07:27:04 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:04 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-161bb371-5062-4770-9325-cba49623be2b" returned: 0 in 0.494s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-161bb371-5062-4770-9325-cba49623be2b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:04 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-161bb371-5062-4770-9325-cba49623be2b Sep 17 07:27:04 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:04 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8" returned: 0 in 0.498s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7dc5ec-1b03-4cb8-9e82-ef20b23a95f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6db844c-33ca-4e1d-be5d-0cdf217d5f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:04 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Volume volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8 (bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8): created successfully Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6db844c-33ca-4e1d-be5d-0cdf217d5f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Flow 'volume_create_manager' (0a93249a-d9ad-40af-a88a-dc5a76588890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:04 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-161bb371-5062-4770-9325-cba49623be2b" returned: 0 in 0.412s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:04 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-35f3ec89-d867-4139-8545-1063a1de73ac tempest-GroupsTest-453854913 None] Created volume successfully. Sep 17 07:27:04 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-93019237-de3d-4b4d-970c-50d474f59969" returned: 0 in 0.688s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-93019237-de3d-4b4d-970c-50d474f59969 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Lock "cinder-quobyte-161bb371-5062-4770-9325-cba49623be2b" released by "delete_volume" :: held 0.994s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:04 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-93019237-de3d-4b4d-970c-50d474f59969 Sep 17 07:27:04 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Created reservations ['3890c568-b8d6-4183-b71f-43dc356607c8', 'f221f415-6198-4249-b035-2833c5dcd3dc', 'a2238c42-324d-4892-9209-57de31a9e37d', '1d9d84eb-ce92-47ff-b3cd-c4de32717ca2'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:04 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:27:04 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:04 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:27:04 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:04 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-93019237-de3d-4b4d-970c-50d474f59969" returned: 0 in 0.405s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Lock "cinder-quobyte-93019237-de3d-4b4d-970c-50d474f59969" released by "delete_volume" :: held 1.170s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Created reservations ['b0b982d4-4551-43d8-ad04-8bc7d3e85772', '5107a996-6f73-4c6a-a2d0-d9a2693da288', 'c3967db0-e447-413a-bb3e-ecb0a9df68e6', '993665dc-d4a8-4b74-ae42-6d2fe247b5b8'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:05 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.390s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:27:05 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:27:05 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:05 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.417s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:27:05 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Deleted volume successfully. Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-90f9a28d-6b1b-47d9-a0b4-ba5bcfe16c65 tempest-VolumesListAdminTestJSON-792096976 None] Lock "cinder-161bb371-5062-4770-9325-cba49623be2b-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:05 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.339s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:27:05 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Deleted volume successfully. Sep 17 07:27:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a34c677f-5312-4659-ad1d-519ee2cae081 tempest-VolumesListAdminTestJSON-846756617 None] Lock "cinder-93019237-de3d-4b4d-970c-50d474f59969-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:05 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-eb33e588-2e34-49da-8467-a14fe972bdf2 tempest-GroupsTest-453854913 None] Update group completed successfully. Sep 17 07:27:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "cinder-b8d53299-a2bd-40b1-9a44-c51e79799371-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Lock "cinder-b8d53299-a2bd-40b1-9a44-c51e79799371-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "cinder-quobyte-b8d53299-a2bd-40b1-9a44-c51e79799371" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Lock "cinder-quobyte-b8d53299-a2bd-40b1-9a44-c51e79799371" acquired by "delete_volume" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:06 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c188a3-f563-4122-8da7-09feaa051b08]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8d53299-a2bd-40b1-9a44-c51e79799371 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:06 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8d53299-a2bd-40b1-9a44-c51e79799371 Sep 17 07:27:06 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:06 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8d53299-a2bd-40b1-9a44-c51e79799371" returned: 0 in 0.445s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8d53299-a2bd-40b1-9a44-c51e79799371 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:06 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8d53299-a2bd-40b1-9a44-c51e79799371 Sep 17 07:27:06 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:06 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b8d53299-a2bd-40b1-9a44-c51e79799371" returned: 0 in 0.275s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Lock "cinder-quobyte-b8d53299-a2bd-40b1-9a44-c51e79799371" released by "delete_volume" :: held 0.766s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Created reservations ['cc53924a-33f0-43ed-bf2b-ea5b09df8a8b', '0631ca6f-ef67-46b2-bf14-956f7ccda58d', '11cc6a3c-d3e1-41b6-8af6-05afcea23fc3', 'a6eaa965-3933-41c9-90c5-162731dd098f'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:07 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:27:07 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:07 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-f71b0421-2744-448c-a068-de2fba226bec tempest-GroupsTest-453854913 None] Update group completed successfully. Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "cinder-1760b2ea-d4e1-4503-add5-e514a4ad3feb-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Lock "cinder-1760b2ea-d4e1-4503-add5-e514a4ad3feb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "cinder-quobyte-1760b2ea-d4e1-4503-add5-e514a4ad3feb" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:07 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Lock "cinder-quobyte-1760b2ea-d4e1-4503-add5-e514a4ad3feb" acquired by "delete_volume" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.401s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:27:07 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Deleted volume successfully. Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7235a934-f64c-4795-86d0-197aeac979d0]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-202ce9b5-4e18-45f7-b4fd-19cc342c5606 tempest-VolumesListAdminTestJSON-846756617 None] Lock "cinder-b8d53299-a2bd-40b1-9a44-c51e79799371-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:07 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb Sep 17 07:27:07 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:07 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb" returned: 0 in 0.487s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:08 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb Sep 17 07:27:08 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:08 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1760b2ea-d4e1-4503-add5-e514a4ad3feb" returned: 0 in 0.309s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Lock "cinder-quobyte-1760b2ea-d4e1-4503-add5-e514a4ad3feb" released by "delete_volume" :: held 0.866s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:08 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Created reservations ['231d94f3-475d-4608-a4fe-f82945f11ec1', '0cf41cc3-7c04-4c30-b9e6-4fa7611b2e33', '28c67868-a53f-4d5a-be4d-110c4d216fee', '42fbdf34-0383-4833-ac5e-252dd4a3c4d9'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:08 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:27:08 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:08 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.383s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:08 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:27:09 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Deleted volume successfully. Sep 17 07:27:09 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b9aff798-6159-47cd-85e0-01999232bd23 tempest-VolumesListAdminTestJSON-846756617 None] Lock "cinder-1760b2ea-d4e1-4503-add5-e514a4ad3feb-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:09 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Acquiring lock "cinder-quobyte-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:09 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Lock "cinder-quobyte-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:09 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aa29ac-b2fe-4138-89ab-fb40976adf40]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:09 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b Sep 17 07:27:09 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:09 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b" returned: 0 in 0.504s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:09 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b Sep 17 07:27:09 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:10 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b" returned: 0 in 0.277s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Lock "cinder-quobyte-a0fd04ea-f71e-42f0-919f-c63d2fc2b26b" released by "delete_volume" :: held 0.848s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Acquiring lock "cinder-quobyte-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Lock "cinder-quobyte-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:10 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[76760c2f-f320-481d-8685-45a8371e04f5]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:10 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8 Sep 17 07:27:10 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:10 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8" returned: 0 in 0.575s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:10 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8 Sep 17 07:27:10 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:11 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8" returned: 0 in 0.296s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Lock "cinder-quobyte-bcc8cd0e-86dc-479e-bbe1-3e1f7e106ac8" released by "delete_volume" :: held 0.942s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:11 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Created reservations ['248744db-feb5-49e0-ac34-8f06c3167267'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:11 devstack cinder-volume[86029]: WARNING cinder.quota [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1563684423 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1563684423, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:27:11 devstack cinder-volume[86029]: WARNING cinder.quota [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1563684423 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1563684423, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:27:11 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Created reservations ['5e4582ae-a99a-430d-ae63-aa9d42019440', 'f04712e9-d14b-40ac-a0c7-f6bc70a187ab', '4e20084f-4c16-4ae1-8d75-1c3f1f4d07f3', '05e97fa2-4c44-4e2d-aa8f-7ad08ff510e0'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:11 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Created reservations ['24afaf34-e76f-457e-9502-2595bb3a6948', '9bc8a044-545a-4b0b-9ba0-3cd2e45b812e', 'f0d60974-2b1e-4b25-9111-f4726095e252', 'ee750811-3116-451e-874a-193912b6ac41'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:11 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:27:11 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:11 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.351s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:11 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:27:11 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-5f8cc22b-8acb-4f01-8d3e-0856b9a10c11 tempest-GroupsTest-453854913 None] Delete group completed successfully. Sep 17 07:27:14 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:27:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Flow 'volume_create_manager' (a0f14eb5-ed9b-4a66-84f7-75c8413b042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d28975-944e-485a-899a-7294a2199a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d28975-944e-485a-899a-7294a2199a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='481b657696f54450a296a682e996cb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:15Z,use_quota=True,user_id='87e2e9add461441b88dd4015b4d904ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bb1a7ff-c0a6-4107-86c8-e4a283a91f18),volume_type_id=6bb1a7ff-c0a6-4107-86c8-e4a283a91f18)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c634215b-398b-42d1-b9e6-1cf623aa4da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c634215b-398b-42d1-b9e6-1cf623aa4da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a58a0ba-58ca-4072-b1d7-600d85add3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:14 devstack cinder-volume[86029]: DEBUG cinder.image.glance [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Creating Keystone auth plugin from conf {{(pid=86029) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 07:27:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a58a0ba-58ca-4072-b1d7-600d85add3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1', 'volume_name': 'volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1', 'volume_size': 1, 'image_id': 'fca193db-3a59-4133-8547-4557c9db7034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fca193db-3a59-4133-8547-4557c9db7034', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c046587c43b09b14795fce1128484fb4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '481b657696f54450a296a682e996cb9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b9d11bfdad698c19da545d619da909d34f6cd00e270d2bb27a54db8a19535889320e337a10b8fe8b64f10c584e5b605fbe3c18fe40b50f3282d095b4709495ac', 'id': 'fca193db-3a59-4133-8547-4557c9db7034', 'created_at': datetime.datetime(2026, 9, 17, 5, 27, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fca193db-3a59-4133-8547-4557c9db7034/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc62c047-8ca9-41b5-967b-31a0a1bd9b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc62c047-8ca9-41b5-967b-31a0a1bd9b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf08d1a-90f0-4679-9719-a7382f057cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:15 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Volume e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1', 'volume_size': 1, 'image_id': 'fca193db-3a59-4133-8547-4557c9db7034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fca193db-3a59-4133-8547-4557c9db7034', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c046587c43b09b14795fce1128484fb4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '481b657696f54450a296a682e996cb9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b9d11bfdad698c19da545d619da909d34f6cd00e270d2bb27a54db8a19535889320e337a10b8fe8b64f10c584e5b605fbe3c18fe40b50f3282d095b4709495ac', 'id': 'fca193db-3a59-4133-8547-4557c9db7034', 'created_at': datetime.datetime(2026, 9, 17, 5, 27, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fca193db-3a59-4133-8547-4557c9db7034/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 17 07:27:15 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Trying to clone e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 from image fca193db-3a59-4133-8547-4557c9db7034 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fca193db-3a59-4133-8547-4557c9db7034', 'metadata': {}}]). {{(pid=86029) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 07:27:16 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Image download 0.00 MB at 0.00 MB/s Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Flow 'volume_create_manager' (b582d855-45f0-42f1-aa51-79bed46dbf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f982a4-fd88-421a-8af4-de301347cd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f982a4-fd88-421a-8af4-de301347cd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1634275738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5229d56-795c-4b63-9839-17d22a4f9586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b380c54277c64ce79682d9c38014bda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:16Z,use_quota=True,user_id='f464377a9cdc41a1a767f6651a062fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76a3554-64ab-44f4-8fe6-9ca91c64f7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76a3554-64ab-44f4-8fe6-9ca91c64f7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06cc6fb-9c19-4f20-b1b7-0c3d5e26ef7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06cc6fb-9c19-4f20-b1b7-0c3d5e26ef7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5229d56-795c-4b63-9839-17d22a4f9586', 'volume_name': 'volume-f5229d56-795c-4b63-9839-17d22a4f9586', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b818bc-90d1-4a26-ba44-578964711450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b818bc-90d1-4a26-ba44-578964711450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d2053c-7a3c-4695-a7f3-03fa59c99d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:16 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Volume f5229d56-795c-4b63-9839-17d22a4f9586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5229d56-795c-4b63-9839-17d22a4f9586', 'volume_size': 1} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1634275738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5229d56-795c-4b63-9839-17d22a4f9586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b380c54277c64ce79682d9c38014bda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:16Z,use_quota=True,user_id='f464377a9cdc41a1a767f6651a062fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Creating volume f5229d56-795c-4b63-9839-17d22a4f9586 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:27:16 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:16 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586 1073741824 Sep 17 07:27:16 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[875809c3-22d7-4c37-a3de-ec8184ca926e]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:16 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD Sep 17 07:27:16 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:16 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:16 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586 1073741824" returned: 0 in 0.535s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:16 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD Sep 17 07:27:16 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:16 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586 Sep 17 07:27:16 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:17 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586" returned: 0 in 0.336s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:17 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD" returned: 1 in 0.482s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Temporary image fca193db-3a59-4133-8547-4557c9db7034 is fetched for user 87e2e9add461441b88dd4015b4d904ef. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d2053c-7a3c-4695-a7f3-03fa59c99d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5229d56-795c-4b63-9839-17d22a4f9586', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb48ba18-384e-4bee-9c14-e665ed04079f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:17 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Volume volume-f5229d56-795c-4b63-9839-17d22a4f9586 (f5229d56-795c-4b63-9839-17d22a4f9586): created successfully Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb48ba18-384e-4bee-9c14-e665ed04079f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Flow 'volume_create_manager' (b582d855-45f0-42f1-aa51-79bed46dbf23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:17 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8f8a2165-f8df-4b4b-805c-0a63fb5f723f tempest-VolumesDeleteCascade-2121916583 None] Created volume successfully. Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aaafb5-c6e7-42ac-8beb-77745200f760]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:17 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD Sep 17 07:27:17 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:17 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:17 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD Sep 17 07:27:17 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:17 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='481b657696f54450a296a682e996cb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:15Z,use_quota=True,user_id='87e2e9add461441b88dd4015b4d904ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bb1a7ff-c0a6-4107-86c8-e4a283a91f18),volume_type_id=6bb1a7ff-c0a6-4107-86c8-e4a283a91f18)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Creating volume e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:27:17 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:27:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:17 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 1073741824 Sep 17 07:27:17 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:18 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 1073741824" returned: 0 in 0.591s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:18 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 Sep 17 07:27:18 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:18 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1" returned: 0 in 0.266s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:27:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.522s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] Creating offline snapshot f8ffdec8-7c21-4d1a-b120-4e186d997c44 of volume f5229d56-795c-4b63-9839-17d22a4f9586 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:27:18 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Attempting download of fca193db-3a59-4133-8547-4557c9db7034 ((None, [{'url': 'file:///opt/stack/data/glance/images/fca193db-3a59-4133-8547-4557c9db7034', 'metadata': {}}])) to volume e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 07:27:18 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e38f830-5b98-485b-b18c-bfedf5d22428]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:18 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69f51ac-009d-4a33-9f4e-5f502e457a5c]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fca193db-3a59-4133-8547-4557c9db7034_hshhxuq2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:19 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586 Sep 17 07:27:19 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:19 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fca193db-3a59-4133-8547-4557c9db7034_hshhxuq2 Sep 17 07:27:19 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:19 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fca193db-3a59-4133-8547-4557c9db7034_hshhxuq2" returned: 0 in 0.374s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fca193db-3a59-4133-8547-4557c9db7034_hshhxuq2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:19 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586" returned: 0 in 0.552s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:19 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fca193db-3a59-4133-8547-4557c9db7034_hshhxuq2 Sep 17 07:27:19 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:19 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 1G Sep 17 07:27:19 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:19 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fca193db-3a59-4133-8547-4557c9db7034_hshhxuq2" returned: 1 in 0.354s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fca193db-3a59-4133-8547-4557c9db7034_hshhxuq2' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:27:19 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdfed19-672e-4afd-9325-3961a551cbab]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:19 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD Sep 17 07:27:19 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:19 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 1G" returned: 0 in 0.555s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5229d56-795c-4b63-9839-17d22a4f9586 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:20 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5229d56-795c-4b63-9839-17d22a4f9586 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 Sep 17 07:27:20 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:20 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:20 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD Sep 17 07:27:20 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:20 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5229d56-795c-4b63-9839-17d22a4f9586 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44" returned: 0 in 0.478s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:20 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 is being set with open permissions: ugo+rw Sep 17 07:27:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:20 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 Sep 17 07:27:20 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:20 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD" returned: 1 in 0.529s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:27:20 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] fca193db-3a59-4133-8547-4557c9db7034 was raw, converting to qcow2 {{(pid=86029) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 07:27:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:20 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 Sep 17 07:27:20 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:20 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44" returned: 0 in 0.400s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:20 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.info Sep 17 07:27:20 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:21 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.info" returned: 0 in 0.327s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:21 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.info is being set with open permissions: ugo+rw Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:21 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.info Sep 17 07:27:21 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:21 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1" returned: 0 in 0.668s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fca193db-3a59-4133-8547-4557c9db7034_kog99mpbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:27:21 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:21 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 1G Sep 17 07:27:21 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.info" returned: 0 in 0.368s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.823s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:21 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-9858c5a1-8ebb-4341-98bf-ca589be575b0 tempest-VolumesDeleteCascade-2121916583 None] Create snapshot completed successfully Sep 17 07:27:21 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:21 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 1G" returned: 0 in 0.440s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Downloaded image fca193db-3a59-4133-8547-4557c9db7034 ((None, [{'url': 'file:///opt/stack/data/glance/images/fca193db-3a59-4133-8547-4557c9db7034', 'metadata': {}}])) to volume e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 successfully. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Temporary image fca193db-3a59-4133-8547-4557c9db7034 for user 87e2e9add461441b88dd4015b4d904ef is deleted. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Marking volume e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 as bootable. {{(pid=86029) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Copying metadata from image fca193db-3a59-4133-8547-4557c9db7034 to e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1. {{(pid=86029) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Creating volume glance metadata for volume e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 backed by image fca193db-3a59-4133-8547-4557c9db7034 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fca193db-3a59-4133-8547-4557c9db7034', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c046587c43b09b14795fce1128484fb4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86029) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf08d1a-90f0-4679-9719-a7382f057cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1', 'volume_size': 1, 'image_id': 'fca193db-3a59-4133-8547-4557c9db7034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fca193db-3a59-4133-8547-4557c9db7034', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c046587c43b09b14795fce1128484fb4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '481b657696f54450a296a682e996cb9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b9d11bfdad698c19da545d619da909d34f6cd00e270d2bb27a54db8a19535889320e337a10b8fe8b64f10c584e5b605fbe3c18fe40b50f3282d095b4709495ac', 'id': 'fca193db-3a59-4133-8547-4557c9db7034', 'created_at': datetime.datetime(2026, 9, 17, 5, 27, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fca193db-3a59-4133-8547-4557c9db7034/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88d93c4-e58f-41f6-9bec-70ba56676edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:21 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Volume volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 (e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1): created successfully Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88d93c4-e58f-41f6-9bec-70ba56676edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Flow 'volume_create_manager' (a0f14eb5-ed9b-4a66-84f7-75c8413b042f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:21 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-aca03ada-2fc4-4703-9fc4-6cc360b3fc23 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Created volume successfully. Sep 17 07:27:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Acquiring lock "cinder-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Lock "cinder-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Acquiring lock "cinder-quobyte-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Lock "cinder-quobyte-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1" acquired by "delete_volume" :: waited 0.031s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:22 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddf7b03-e117-460e-90ff-da7670614b67]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] Creating offline snapshot 0a82aef3-def8-4d50-bb14-466cc6a8bebb of volume f5229d56-795c-4b63-9839-17d22a4f9586 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:27:22 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 Sep 17 07:27:22 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:22 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4084101d-d93f-42cd-9968-1fc66a4b19cf]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:23 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 Sep 17 07:27:23 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:23 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1" returned: 0 in 0.513s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:23 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1 Sep 17 07:27:23 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:23 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1" returned: 0 in 0.294s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Lock "cinder-quobyte-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1" released by "delete_volume" :: held 0.878s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:23 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44" returned: 0 in 0.576s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5229d56-795c-4b63-9839-17d22a4f9586(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:27:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:23 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb 1G Sep 17 07:27:23 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:23 devstack cinder-volume[86029]: WARNING cinder.quota [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:27:23 devstack cinder-volume[86029]: WARNING cinder.quota [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:27:23 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Created reservations ['026e05a4-411b-48b9-9af4-714c82d9e99e', 'a5cde258-86b9-45f1-a354-2d9acee59e22', 'cf7f5e3e-cae9-4954-a98f-f7bbf1352ff7', '121061f4-bcc1-40fc-bf84-fc221fc43caa'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:23 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:27:23 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:24 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.309s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:24 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:27:24 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Deleted volume successfully. Sep 17 07:27:24 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb 1G" returned: 0 in 0.547s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:24 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb Sep 17 07:27:24 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cd5fd2b3-fe85-4363-b661-ead572c61fd9 tempest-VolumeAndVolumeTypeFromImageTest-227828268 None] Lock "cinder-e27a62ab-7d28-41dc-92b7-6f4fb3b9beb1-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:24 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb" returned: 0 in 0.387s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:24 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb is being set with open permissions: ugo+rw Sep 17 07:27:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:24 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb Sep 17 07:27:24 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:24 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb" returned: 0 in 0.331s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:24 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-ec17aabf-6609-4277-9c51-281edc65d471 tempest-VolumesDeleteCascade-2121916583 None] Create snapshot completed successfully Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-f5229d56-795c-4b63-9839-17d22a4f9586-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-f5229d56-795c-4b63-9839-17d22a4f9586-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Performing cascade delete. {{(pid=86029) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-0a82aef3-def8-4d50-bb14-466cc6a8bebb-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-0a82aef3-def8-4d50-bb14-466cc6a8bebb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-quobyte-f5229d56-795c-4b63-9839-17d22a4f9586" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-f5229d56-795c-4b63-9839-17d22a4f9586" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-quobyte-0a82aef3-def8-4d50-bb14-466cc6a8bebb" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-0a82aef3-def8-4d50-bb14-466cc6a8bebb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Deleting offline snapshot 0a82aef3-def8-4d50-bb14-466cc6a8bebb of volume f5229d56-795c-4b63-9839-17d22a4f9586 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] snapshot_file for this snap is: volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7fae53-719b-4584-99a9-d45a3b658cb4]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:26 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb Sep 17 07:27:26 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:26 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb" returned: 0 in 0.501s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5229d56-795c-4b63-9839-17d22a4f9586(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed2447e-a37e-41ee-82fa-64526d8e02ac]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:26 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 Sep 17 07:27:26 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:27 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44" returned: 0 in 0.463s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5229d56-795c-4b63-9839-17d22a4f9586(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:27:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:27 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb Sep 17 07:27:27 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:27 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb" returned: 0 in 0.506s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:27 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb Sep 17 07:27:27 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:28 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.0a82aef3-def8-4d50-bb14-466cc6a8bebb" returned: 0 in 0.325s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-0a82aef3-def8-4d50-bb14-466cc6a8bebb" released by "_delete_snapshot" :: held 1.947s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-f5229d56-795c-4b63-9839-17d22a4f9586" released by "delete_snapshot" :: held 1.978s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Created reservations ['8e0f5c94-4b87-4bfb-a01d-1c749122c8a4', '258a7f98-68cf-4f86-bc6d-faacc81d4c91', '0eb97c12-2e75-4a72-ae08-b49cc3ca5e24', '6818782f-e92c-471f-b536-fceb5eca2b75'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:28 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Delete snapshot completed successfully. Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-0a82aef3-def8-4d50-bb14-466cc6a8bebb-delete_snapshot" released by "delete_snapshot" :: held 2.247s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-f8ffdec8-7c21-4d1a-b120-4e186d997c44-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-f8ffdec8-7c21-4d1a-b120-4e186d997c44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-quobyte-f5229d56-795c-4b63-9839-17d22a4f9586" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-f5229d56-795c-4b63-9839-17d22a4f9586" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-quobyte-f8ffdec8-7c21-4d1a-b120-4e186d997c44" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-f8ffdec8-7c21-4d1a-b120-4e186d997c44" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Deleting offline snapshot f8ffdec8-7c21-4d1a-b120-4e186d997c44 of volume f5229d56-795c-4b63-9839-17d22a4f9586 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] snapshot_file for this snap is: volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[61edbe37-ce69-46cb-b8e3-5b6abab51caa]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:28 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 Sep 17 07:27:28 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:28 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44" returned: 0 in 0.386s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5229d56-795c-4b63-9839-17d22a4f9586(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[801e68db-9875-4bcb-8b2e-c765ccf144ca]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:29 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586 Sep 17 07:27:29 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:29 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586" returned: 0 in 0.446s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:29 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 Sep 17 07:27:29 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:29 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44" returned: 0 in 0.410s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:29 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44 Sep 17 07:27:29 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:30 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586.f8ffdec8-7c21-4d1a-b120-4e186d997c44" returned: 0 in 0.340s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-f8ffdec8-7c21-4d1a-b120-4e186d997c44" released by "_delete_snapshot" :: held 1.724s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-f5229d56-795c-4b63-9839-17d22a4f9586" released by "delete_snapshot" :: held 1.763s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Created reservations ['ab0156af-c4a4-4607-a981-7865b3367c10', 'e6be12ca-bf2b-4b20-8de7-a88f21dd1156', '42adb9db-a4f7-41b6-bf40-441d6bceac64', 'e5a37966-f795-419b-8a92-dc4c812d787d'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Flow 'volume_create_manager' (df3ee4bf-7df5-4d94-8692-0b297c03e3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bfed325-6b37-4f9d-9647-8eccb1678e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bfed325-6b37-4f9d-9647-8eccb1678e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1079304358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a3d06d-2e13-491c-9789-a4ef6c872e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1490d41ad596493baacb3df7b261c3ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:30Z,use_quota=True,user_id='375a125ccc8c41259fc237da7b9321cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4dd4957-9903-4e1c-9626-2b7118871949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4dd4957-9903-4e1c-9626-2b7118871949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22dc3867-0bc1-4131-81ea-e14ed1e426f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22dc3867-0bc1-4131-81ea-e14ed1e426f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5a3d06d-2e13-491c-9789-a4ef6c872e96', 'volume_name': 'volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37e0989-0c5a-4bf1-881f-e8658a42f1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37e0989-0c5a-4bf1-881f-e8658a42f1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95e2a09-9195-441d-a21d-67de41e29f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:30 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Volume f5a3d06d-2e13-491c-9789-a4ef6c872e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96', 'volume_size': 1} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1079304358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a3d06d-2e13-491c-9789-a4ef6c872e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1490d41ad596493baacb3df7b261c3ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:30Z,use_quota=True,user_id='375a125ccc8c41259fc237da7b9321cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Creating volume f5a3d06d-2e13-491c-9789-a4ef6c872e96 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:27:30 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:30 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96 1073741824 Sep 17 07:27:30 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:30 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Delete snapshot completed successfully. Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-f8ffdec8-7c21-4d1a-b120-4e186d997c44-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Snapshots deleted, issuing volume delete {{(pid=86029) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-quobyte-f5229d56-795c-4b63-9839-17d22a4f9586" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-f5229d56-795c-4b63-9839-17d22a4f9586" acquired by "delete_volume" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7c1b1b-64d7-4a1a-8e88-ebc485ac8e26]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:30 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586 Sep 17 07:27:30 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Flow 'volume_create_manager' (bcd8764b-ddf0-4c1c-8c70-b2bdf2a9c928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08ccd84-2c07-4b58-82ee-f32f0685b8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08ccd84-2c07-4b58-82ee-f32f0685b8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-674536014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a41406e-d1dc-4949-96e1-f69407f9125b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587f83e128df48c6abaaf5ac24c139e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:31Z,use_quota=True,user_id='761c5a7d704a422199ec96db5f9f995b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5c8126-8f40-4355-978e-3d56063745f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5c8126-8f40-4355-978e-3d56063745f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7ec7c4-0c18-4c10-ae23-fa2f4144c800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7ec7c4-0c18-4c10-ae23-fa2f4144c800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a41406e-d1dc-4949-96e1-f69407f9125b', 'volume_name': 'volume-1a41406e-d1dc-4949-96e1-f69407f9125b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34617b9b-e29c-4088-ac97-429842ad18c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34617b9b-e29c-4088-ac97-429842ad18c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b08b0d-9f93-444c-89fe-df8304395c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:31 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:31 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Volume 1a41406e-d1dc-4949-96e1-f69407f9125b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a41406e-d1dc-4949-96e1-f69407f9125b', 'volume_size': 1} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586" returned: 0 in 0.460s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:31 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96 1073741824" returned: 0 in 0.681s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:31 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586 Sep 17 07:27:31 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:31 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96 Sep 17 07:27:31 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:31 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5229d56-795c-4b63-9839-17d22a4f9586" returned: 0 in 0.312s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-f5229d56-795c-4b63-9839-17d22a4f9586" released by "delete_volume" :: held 0.843s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:31 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96" returned: 0 in 0.288s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-674536014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a41406e-d1dc-4949-96e1-f69407f9125b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587f83e128df48c6abaaf5ac24c139e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:31Z,use_quota=True,user_id='761c5a7d704a422199ec96db5f9f995b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Creating volume 1a41406e-d1dc-4949-96e1-f69407f9125b {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:27:31 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:31 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b 1073741824 Sep 17 07:27:31 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95e2a09-9195-441d-a21d-67de41e29f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ec5b7f-0a7e-48ac-bd8c-34a261940c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:31 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Volume volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96 (f5a3d06d-2e13-491c-9789-a4ef6c872e96): created successfully Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ec5b7f-0a7e-48ac-bd8c-34a261940c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Flow 'volume_create_manager' (df3ee4bf-7df5-4d94-8692-0b297c03e3c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:31 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-f6ae9be7-447b-4699-8d7a-ff1847aabbdf tempest-VolumesTransfersTest-366179398 None] Created volume successfully. Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Created reservations ['cbd0337c-df67-4aa2-b6d8-c739b2cf921c', 'fa8bec1e-43fe-4e11-b233-05c1f8868565', '40f26888-96bc-4755-8f8a-6c8f10424ae5', '1a9928e2-86b8-4754-9fa8-ab98969f66a6'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:31 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:27:31 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:32 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.298s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:32 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:27:32 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Deleted volume successfully. Sep 17 07:27:32 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3543d112-b6f3-4443-9004-80f2de00bb23 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-f5229d56-795c-4b63-9839-17d22a4f9586-delete_volume" released by "delete_volume" :: held 6.042s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b 1073741824" returned: 0 in 0.555s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:32 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b Sep 17 07:27:32 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:32 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b" returned: 0 in 0.282s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:27:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b08b0d-9f93-444c-89fe-df8304395c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a41406e-d1dc-4949-96e1-f69407f9125b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9248ad12-5fe5-4f2b-887f-33638f02209d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:32 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Volume volume-1a41406e-d1dc-4949-96e1-f69407f9125b (1a41406e-d1dc-4949-96e1-f69407f9125b): created successfully Sep 17 07:27:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9248ad12-5fe5-4f2b-887f-33638f02209d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Flow 'volume_create_manager' (bcd8764b-ddf0-4c1c-8c70-b2bdf2a9c928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:32 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-24600f48-cfd7-4ed7-b160-1ac99266ac4e tempest-VolumeDependencyTests-2081443521 None] Created volume successfully. Sep 17 07:27:33 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-23d27bec-7413-4b0f-9611-8b43a1d6e792 tempest-VolumesTransfersTest-243487318 None] Transfer volume completed successfully. Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Flow 'volume_create_manager' (ec0e9ba2-958e-4283-9440-c704ee6c9e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5dd861-eb31-41b7-88c1-2790cdc6fa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5dd861-eb31-41b7-88c1-2790cdc6fa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-348259560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8341532d-ddf5-4d6b-a0ea-d16e3a9267b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b380c54277c64ce79682d9c38014bda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:34Z,use_quota=True,user_id='f464377a9cdc41a1a767f6651a062fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb16bb6-a44f-4072-a5c9-2bce5d65445b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb16bb6-a44f-4072-a5c9-2bce5d65445b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34aaf4ae-5559-4a50-b4b0-0b0e8b379d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34aaf4ae-5559-4a50-b4b0-0b0e8b379d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8341532d-ddf5-4d6b-a0ea-d16e3a9267b9', 'volume_name': 'volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e8c824-8e56-4542-961d-9e1793d0ea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e8c824-8e56-4542-961d-9e1793d0ea3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8293c9d6-456d-4110-adb3-51a27cf7b762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:33 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Volume 8341532d-ddf5-4d6b-a0ea-d16e3a9267b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9', 'volume_size': 1} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-348259560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8341532d-ddf5-4d6b-a0ea-d16e3a9267b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b380c54277c64ce79682d9c38014bda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:34Z,use_quota=True,user_id='f464377a9cdc41a1a767f6651a062fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Creating volume 8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:27:33 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:33 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 1073741824 Sep 17 07:27:33 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Acquiring lock "cinder-f5a3d06d-2e13-491c-9789-a4ef6c872e96-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Lock "cinder-f5a3d06d-2e13-491c-9789-a4ef6c872e96-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:34 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 1073741824" returned: 0 in 0.525s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Acquiring lock "cinder-quobyte-f5a3d06d-2e13-491c-9789-a4ef6c872e96" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Lock "cinder-quobyte-f5a3d06d-2e13-491c-9789-a4ef6c872e96" acquired by "delete_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6a6f23-c562-492d-8fb8-8cf623407e66]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:34 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 Sep 17 07:27:34 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:34 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96 Sep 17 07:27:34 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:34 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9" returned: 0 in 0.344s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.979s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8293c9d6-456d-4110-adb3-51a27cf7b762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e1d8d1-07d6-4d6d-838f-e3aa517c2fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] Creating offline snapshot 6d9049a3-aa6e-4497-b1f7-680086191622 of volume 1a41406e-d1dc-4949-96e1-f69407f9125b {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:27:34 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Volume volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 (8341532d-ddf5-4d6b-a0ea-d16e3a9267b9): created successfully Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e1d8d1-07d6-4d6d-838f-e3aa517c2fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Flow 'volume_create_manager' (ec0e9ba2-958e-4283-9440-c704ee6c9e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ee2858-66d4-4373-8400-c3293991fb30]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:34 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-6ab47d1e-9ef3-48fe-9b00-27c8bd6e3803 tempest-VolumesDeleteCascade-2121916583 None] Created volume successfully. Sep 17 07:27:34 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96" returned: 0 in 0.487s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:34 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96 Sep 17 07:27:34 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:34 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b Sep 17 07:27:34 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:35 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f5a3d06d-2e13-491c-9789-a4ef6c872e96" returned: 0 in 0.267s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Lock "cinder-quobyte-f5a3d06d-2e13-491c-9789-a4ef6c872e96" released by "delete_volume" :: held 0.821s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Created reservations ['7f584d15-15dd-4cbe-b180-5c9967099e23', '6535bcd0-4562-44b2-877b-8fe05956c018', 'd4517597-9367-4e84-a762-473257b6a74e', '7d9bdb09-8d07-43e1-9c2a-c987527c22f4'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:35 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b" returned: 0 in 0.418s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:35 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 1G Sep 17 07:27:35 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:35 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:27:35 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:35 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.338s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:27:35 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Deleted volume successfully. Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0726f10d-3e8e-4c84-93dd-774cd96d3f61 tempest-VolumesTransfersTest-1170919332 None] Lock "cinder-f5a3d06d-2e13-491c-9789-a4ef6c872e96-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:35 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 1G" returned: 0 in 0.573s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a41406e-d1dc-4949-96e1-f69407f9125b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:35 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a41406e-d1dc-4949-96e1-f69407f9125b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 Sep 17 07:27:35 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Flow 'volume_create_manager' (d277a506-bc5e-4545-9717-11d76bcd14f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b158ab2c-96e8-4a10-a09c-093859b97e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b158ab2c-96e8-4a10-a09c-093859b97e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1815072256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8f23ad-8473-45b4-b219-baf9a0937d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1490d41ad596493baacb3df7b261c3ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:36Z,use_quota=True,user_id='375a125ccc8c41259fc237da7b9321cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab8d630-1aba-40d4-bed2-645412fb62a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab8d630-1aba-40d4-bed2-645412fb62a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46121b5-b14d-4232-9326-03e03342c94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46121b5-b14d-4232-9326-03e03342c94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8f23ad-8473-45b4-b219-baf9a0937d39', 'volume_name': 'volume-1c8f23ad-8473-45b4-b219-baf9a0937d39', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40c893b-2b41-4ee0-a60b-920f79b756c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40c893b-2b41-4ee0-a60b-920f79b756c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98208bb6-c4f4-4b69-a2b6-3140f35096c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:36 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Volume 1c8f23ad-8473-45b4-b219-baf9a0937d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8f23ad-8473-45b4-b219-baf9a0937d39', 'volume_size': 1} Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:36 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a41406e-d1dc-4949-96e1-f69407f9125b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622" returned: 0 in 0.408s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:36 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 is being set with open permissions: ugo+rw Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:36 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 Sep 17 07:27:36 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:36 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622" returned: 0 in 0.273s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:36 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.info Sep 17 07:27:36 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:36 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.info" returned: 0 in 0.263s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:36 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.info is being set with open permissions: ugo+rw Sep 17 07:27:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:36 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.info Sep 17 07:27:36 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:37 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.info" returned: 0 in 0.256s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.325s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1815072256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8f23ad-8473-45b4-b219-baf9a0937d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1490d41ad596493baacb3df7b261c3ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:36Z,use_quota=True,user_id='375a125ccc8c41259fc237da7b9321cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Creating volume 1c8f23ad-8473-45b4-b219-baf9a0937d39 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:27:37 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1c8f23ad-8473-45b4-b219-baf9a0937d39 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:37 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1c8f23ad-8473-45b4-b219-baf9a0937d39 1073741824 Sep 17 07:27:37 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:37 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-49a2444e-8eea-460a-a759-44659a10df6e tempest-VolumeDependencyTests-2081443521 None] Create snapshot completed successfully Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Flow 'volume_create_manager' (fbfce825-95b7-4772-9b8c-3ddaedeec1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c0236a-6e34-48ac-ace3-d18e73cd37d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c0236a-6e34-48ac-ace3-d18e73cd37d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1073962379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba28a72-3dfa-465b-8d8b-338f0f582d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d140f6a195b4cae8559456598ffe674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:37Z,use_quota=True,user_id='b522dbf60cff4eb0acc8eb8e1ac5debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885120c3-265e-4f11-acbd-1390fea99623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885120c3-265e-4f11-acbd-1390fea99623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af186bf2-e7b3-4ac7-9f63-fc650e7294bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af186bf2-e7b3-4ac7-9f63-fc650e7294bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ba28a72-3dfa-465b-8d8b-338f0f582d35', 'volume_name': 'volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41049961-9085-4e91-a7d1-07a34cbc3b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41049961-9085-4e91-a7d1-07a34cbc3b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157d6baf-0bcc-47d6-b7a9-1095e36d2c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:37 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Volume 8ba28a72-3dfa-465b-8d8b-338f0f582d35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35', 'volume_size': 1} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:37 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1c8f23ad-8473-45b4-b219-baf9a0937d39 1073741824" returned: 0 in 0.445s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1c8f23ad-8473-45b4-b219-baf9a0937d39 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:37 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1c8f23ad-8473-45b4-b219-baf9a0937d39 Sep 17 07:27:37 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:37 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1c8f23ad-8473-45b4-b219-baf9a0937d39" returned: 0 in 0.243s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.604s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98208bb6-c4f4-4b69-a2b6-3140f35096c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8f23ad-8473-45b4-b219-baf9a0937d39', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ae751f-74e8-4cc1-ae21-3edecce7c4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] Creating offline snapshot 817c0fe6-580d-4103-a2e7-98414268f3e7 of volume 8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:27:37 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Volume volume-1c8f23ad-8473-45b4-b219-baf9a0937d39 (1c8f23ad-8473-45b4-b219-baf9a0937d39): created successfully Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ae751f-74e8-4cc1-ae21-3edecce7c4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Flow 'volume_create_manager' (d277a506-bc5e-4545-9717-11d76bcd14f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7720e288-51f1-4039-90a2-e86c1219b3c7]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:37 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1c286da0-fb9f-4a15-8433-ae82db0e80cd tempest-VolumesTransfersTest-366179398 None] Created volume successfully. Sep 17 07:27:38 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 Sep 17 07:27:38 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:38 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9" returned: 0 in 0.460s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:38 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 1G Sep 17 07:27:38 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Flow 'volume_create_manager' (8f79810c-2095-423b-b07a-88d5697be1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d936dc-5967-4ce1-aefc-e5d977fcded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Acquiring lock "cinder-1c8f23ad-8473-45b4-b219-baf9a0937d39-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d936dc-5967-4ce1-aefc-e5d977fcded0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1878494845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ff13db-2c30-4641-aadc-1e2fe0e0e3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587f83e128df48c6abaaf5ac24c139e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d9049a3-aa6e-4497-b1f7-680086191622,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:38Z,use_quota=True,user_id='761c5a7d704a422199ec96db5f9f995b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0166305d-b46f-4cae-b034-9c32b5ea8e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0166305d-b46f-4cae-b034-9c32b5ea8e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7afa99-6117-4550-9b7a-db3536e73455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7afa99-6117-4550-9b7a-db3536e73455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '05ff13db-2c30-4641-aadc-1e2fe0e0e3b3', 'volume_name': 'volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3', 'volume_size': 1, 'snapshot_id': '6d9049a3-aa6e-4497-b1f7-680086191622'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e48e63-304b-4b4a-a8ee-acaf914e9eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e48e63-304b-4b4a-a8ee-acaf914e9eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ec11b1-cc54-4511-af36-a1791820f3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:38 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Volume 05ff13db-2c30-4641-aadc-1e2fe0e0e3b3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3', 'volume_size': 1, 'snapshot_id': '6d9049a3-aa6e-4497-b1f7-680086191622'} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Lock "cinder-1c8f23ad-8473-45b4-b219-baf9a0937d39-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Acquiring lock "cinder-quobyte-1c8f23ad-8473-45b4-b219-baf9a0937d39" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Lock "cinder-quobyte-1c8f23ad-8473-45b4-b219-baf9a0937d39" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[de36ef15-60b3-4432-bfd1-94d09cc69509]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1c8f23ad-8473-45b4-b219-baf9a0937d39 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:38 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1c8f23ad-8473-45b4-b219-baf9a0937d39 Sep 17 07:27:38 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:38 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 1G" returned: 0 in 0.470s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:38 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 Sep 17 07:27:38 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:39 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1c8f23ad-8473-45b4-b219-baf9a0937d39" returned: 0 in 0.388s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1c8f23ad-8473-45b4-b219-baf9a0937d39 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:39 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1c8f23ad-8473-45b4-b219-baf9a0937d39 Sep 17 07:27:39 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:39 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7" returned: 0 in 0.301s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:39 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 is being set with open permissions: ugo+rw Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:39 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 Sep 17 07:27:39 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:39 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1c8f23ad-8473-45b4-b219-baf9a0937d39" returned: 0 in 0.263s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Lock "cinder-quobyte-1c8f23ad-8473-45b4-b219-baf9a0937d39" released by "delete_volume" :: held 0.700s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:39 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7" returned: 0 in 0.282s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Created reservations ['6086f3ce-cabe-4144-86d4-f670c35e5e0e', '0c77b165-67f8-4960-ba7a-3c1cc88ffe36', '38652e74-5823-4811-a9bc-8596f4015e8e', '2645a085-e251-46ae-aa4c-79edf81bad96'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:39 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.info Sep 17 07:27:39 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:39 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:27:39 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:39 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.info" returned: 0 in 0.284s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:39 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.info is being set with open permissions: ugo+rw Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:39 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:39 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.info Sep 17 07:27:39 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.257s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:27:39 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Deleted volume successfully. Sep 17 07:27:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-da270aa8-724c-4af5-a193-955c21f2dc10 tempest-VolumesTransfersTest-1170919332 None] Lock "cinder-1c8f23ad-8473-45b4-b219-baf9a0937d39-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:40 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.info" returned: 0 in 0.266s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.188s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.644s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1073962379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba28a72-3dfa-465b-8d8b-338f0f582d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d140f6a195b4cae8559456598ffe674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:37Z,use_quota=True,user_id='b522dbf60cff4eb0acc8eb8e1ac5debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Creating volume 8ba28a72-3dfa-465b-8d8b-338f0f582d35 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:27:40 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:40 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35 1073741824 Sep 17 07:27:40 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:40 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-41e52b5b-6103-4af4-b0a8-fe3fd96a9913 tempest-VolumesDeleteCascade-2121916583 None] Create snapshot completed successfully Sep 17 07:27:40 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35 1073741824" returned: 0 in 0.513s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:40 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35 Sep 17 07:27:40 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:40 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35" returned: 0 in 0.284s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.284s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "cinder-quobyte-6d9049a3-aa6e-4497-b1f7-680086191622-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3" by "_create_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157d6baf-0bcc-47d6-b7a9-1095e36d2c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7814a9-4d41-4fc6-b723-0e8917af79e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:40 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Volume volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35 (8ba28a72-3dfa-465b-8d8b-338f0f582d35): created successfully Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7814a9-4d41-4fc6-b723-0e8917af79e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Flow 'volume_create_manager' (fbfce825-95b7-4772-9b8c-3ddaedeec1c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-quobyte-6d9049a3-aa6e-4497-b1f7-680086191622-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3" acquired by "_create_volume_from_snapshot" :: waited 0.063s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Creating volume 05ff13db-2c30-4641-aadc-1e2fe0e0e3b3 from snapshot 6d9049a3-aa6e-4497-b1f7-680086191622 {{(pid=86029) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "cinder-quobyte-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3" by "_copy_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-quobyte-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] snapshot: 6d9049a3-aa6e-4497-b1f7-680086191622, volume: 05ff13db-2c30-4641-aadc-1e2fe0e0e3b3, {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 07:27:40 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cf5e6bee-1ffb-4ed1-afbf-95365a6bebc6 tempest-VolumeQuotasAdminTestJSON-933324113 None] Created volume successfully. Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3301b356-de6c-49d1-82ff-62fda09caebf]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Flow 'volume_create_manager' (4221b823-5db7-4fd8-ad6f-700e75845d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc84603a-669c-4736-8cb4-fb9eaaad6863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc84603a-669c-4736-8cb4-fb9eaaad6863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1792402038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6ea4242-363e-444e-9b1c-cde1ede031c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b380c54277c64ce79682d9c38014bda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=817c0fe6-580d-4103-a2e7-98414268f3e7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:41Z,use_quota=True,user_id='f464377a9cdc41a1a767f6651a062fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa957d4-fbfb-4464-aa5f-3e038ed338f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa957d4-fbfb-4464-aa5f-3e038ed338f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:41 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 Sep 17 07:27:41 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09674e07-14fb-421c-a8c2-64ebe33654b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09674e07-14fb-421c-a8c2-64ebe33654b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd6ea4242-363e-444e-9b1c-cde1ede031c5', 'volume_name': 'volume-d6ea4242-363e-444e-9b1c-cde1ede031c5', 'volume_size': 1, 'snapshot_id': '817c0fe6-580d-4103-a2e7-98414268f3e7'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9985b4de-52cb-4627-84f0-1a24efb50a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9985b4de-52cb-4627-84f0-1a24efb50a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d83c5e-42b7-4274-8fd1-5f50ffa3e66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:41 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Volume d6ea4242-363e-444e-9b1c-cde1ede031c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d6ea4242-363e-444e-9b1c-cde1ede031c5', 'volume_size': 1, 'snapshot_id': '817c0fe6-580d-4103-a2e7-98414268f3e7'} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:41 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622" returned: 0 in 0.400s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a41406e-d1dc-4949-96e1-f69407f9125b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[de922436-42da-47bb-8363-e3d7d80ef58e]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:41 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b Sep 17 07:27:41 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Acquiring lock "cinder-8ba28a72-3dfa-465b-8d8b-338f0f582d35-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Lock "cinder-8ba28a72-3dfa-465b-8d8b-338f0f582d35-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Acquiring lock "cinder-quobyte-8ba28a72-3dfa-465b-8d8b-338f0f582d35" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Lock "cinder-quobyte-8ba28a72-3dfa-465b-8d8b-338f0f582d35" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[689bbac4-a3a7-4668-91ab-b03812431847]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:41 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b" returned: 0 in 0.437s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] will copy from snapshot at /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Creating direct copy from snapshot {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG cinder.utils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Path /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3 not found in is_blk_device check {{(pid=86029) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 07:27:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:41 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3 Sep 17 07:27:41 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:42 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35 Sep 17 07:27:42 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:42 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35" returned: 0 in 0.432s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:42 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35 Sep 17 07:27:42 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:42 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8ba28a72-3dfa-465b-8d8b-338f0f582d35" returned: 0 in 0.326s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:42 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Lock "cinder-quobyte-8ba28a72-3dfa-465b-8d8b-338f0f582d35" released by "delete_volume" :: held 0.829s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:42 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Created reservations ['2e9eea11-174b-492a-ba48-31147a58af3d', '3dd391a7-cd25-492b-9f9a-51c10c0846b4', 'e5c88ee7-de0c-4f0a-81e4-866841925428', '7893f402-b462-4d89-8552-2612684a132e'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:42 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:27:42 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:43 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.414s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:43 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:27:43 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Deleted volume successfully. Sep 17 07:27:43 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ba17a367-7c55-4830-9883-4ac5ea41e8df tempest-VolumeQuotasAdminTestJSON-933324113 None] Lock "cinder-8ba28a72-3dfa-465b-8d8b-338f0f582d35-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:44 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:27:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Flow 'volume_create_manager' (de80b00f-c81d-4d32-8ff8-20041ae545be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2899932-cc7a-4bb3-bd00-dfbbdb8928ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2899932-cc7a-4bb3-bd00-dfbbdb8928ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1215690732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120e84f1-6996-4960-ab18-ce701b600c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d140f6a195b4cae8559456598ffe674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:44Z,use_quota=True,user_id='b522dbf60cff4eb0acc8eb8e1ac5debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b9e6bf-1928-4711-a839-d91af1db6595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b9e6bf-1928-4711-a839-d91af1db6595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88bd631-3e35-4d36-b7ea-b7ed81c7832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88bd631-3e35-4d36-b7ea-b7ed81c7832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '120e84f1-6996-4960-ab18-ce701b600c33', 'volume_name': 'volume-120e84f1-6996-4960-ab18-ce701b600c33', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16232a4c-0acb-4f84-a83f-9cc495f1cc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16232a4c-0acb-4f84-a83f-9cc495f1cc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810e38b7-51d1-4cce-9ba6-186be36ba582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:44 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Volume 120e84f1-6996-4960-ab18-ce701b600c33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-120e84f1-6996-4960-ab18-ce701b600c33', 'volume_size': 1} Sep 17 07:27:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:49 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3" returned: 0 in 7.805s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:49 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b, size 1024.00 MB, duration 7.81 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:27:49 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Converted 1024.00 MB image at 131.17 MB/s Sep 17 07:27:49 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3 is being set with open permissions: ugo+rw Sep 17 07:27:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:49 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3 Sep 17 07:27:49 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:49 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3" returned: 0 in 0.259s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-quobyte-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3" released by "_copy_volume_from_snapshot" :: held 9.005s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:49 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=153,cinder:UPDATE=210,cinder:INSERT=61,cinder:DELETE=18 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:27:49 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=174,cinder:UPDATE=207,cinder:INSERT=44,cinder:DELETE=16 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-quobyte-6d9049a3-aa6e-4497-b1f7-680086191622-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3" released by "_create_volume_from_snapshot" :: held 9.089s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.154s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.835s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-quobyte-817c0fe6-580d-4103-a2e7-98414268f3e7-d6ea4242-363e-444e-9b1c-cde1ede031c5" by "_create_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-817c0fe6-580d-4103-a2e7-98414268f3e7-d6ea4242-363e-444e-9b1c-cde1ede031c5" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Creating volume d6ea4242-363e-444e-9b1c-cde1ede031c5 from snapshot 817c0fe6-580d-4103-a2e7-98414268f3e7 {{(pid=86029) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-quobyte-d6ea4242-363e-444e-9b1c-cde1ede031c5" by "_copy_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ec11b1-cc54-4511-af36-a1791820f3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3', 'volume_size': 1, 'snapshot_id': '6d9049a3-aa6e-4497-b1f7-680086191622'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856a06cb-de3d-4cc9-a1ad-cc91023585a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-d6ea4242-363e-444e-9b1c-cde1ede031c5" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] snapshot: 817c0fe6-580d-4103-a2e7-98414268f3e7, volume: d6ea4242-363e-444e-9b1c-cde1ede031c5, {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:50 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Volume volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3 (05ff13db-2c30-4641-aadc-1e2fe0e0e3b3): created successfully Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856a06cb-de3d-4cc9-a1ad-cc91023585a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Flow 'volume_create_manager' (8f79810c-2095-423b-b07a-88d5697be1a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b8e0d9-8058-41d4-872a-604caa122341]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:50 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-f3420766-b1f1-4f24-b7bd-f2f8caa23df9 tempest-VolumeDependencyTests-2081443521 None] Created volume successfully. Sep 17 07:27:50 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 Sep 17 07:27:50 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:50 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7" returned: 0 in 0.389s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc63fbd-31cc-409e-8114-911ee9fb6fc6]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "cinder-6d9049a3-aa6e-4497-b1f7-680086191622-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-6d9049a3-aa6e-4497-b1f7-680086191622-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "cinder-quobyte-1a41406e-d1dc-4949-96e1-f69407f9125b" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-quobyte-1a41406e-d1dc-4949-96e1-f69407f9125b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "cinder-quobyte-6d9049a3-aa6e-4497-b1f7-680086191622" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-quobyte-6d9049a3-aa6e-4497-b1f7-680086191622" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Deleting offline snapshot 6d9049a3-aa6e-4497-b1f7-680086191622 of volume 1a41406e-d1dc-4949-96e1-f69407f9125b {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] snapshot_file for this snap is: volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b61e3be-2bc8-46a5-aa71-b3ad4cbc194a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:50 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 Sep 17 07:27:50 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:50 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 Sep 17 07:27:50 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:51 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9" returned: 0 in 0.497s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] will copy from snapshot at /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Creating direct copy from snapshot {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.utils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Path /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5 not found in is_blk_device check {{(pid=86029) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:51 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5 Sep 17 07:27:51 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Flow 'volume_create_manager' (15b5a33c-dbe7-4da8-803f-e166e8b86103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2040a6-ec27-40b1-b9c7-053738a00d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2040a6-ec27-40b1-b9c7-053738a00d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-654316210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046268d4-a7a9-4785-b65e-df5fbf226a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222ecbce78af4ee4adff6f5656f15376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:51Z,use_quota=True,user_id='46072bdf65b046fca6956706f1c4e0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ded030-172e-404c-b31f-8b24b6ced110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ded030-172e-404c-b31f-8b24b6ced110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4522f233-a167-4903-a9e8-013b74f36b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:51 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4522f233-a167-4903-a9e8-013b74f36b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '046268d4-a7a9-4785-b65e-df5fbf226a3a', 'volume_name': 'volume-046268d4-a7a9-4785-b65e-df5fbf226a3a', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa7e354-1630-4ba7-ae80-d8196eff6e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa7e354-1630-4ba7-ae80-d8196eff6e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26481286-542a-4810-b1e8-ea76a9bffa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:51 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Volume 046268d4-a7a9-4785-b65e-df5fbf226a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-046268d4-a7a9-4785-b65e-df5fbf226a3a', 'volume_size': 1} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622" returned: 0 in 0.482s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a41406e-d1dc-4949-96e1-f69407f9125b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9696a578-cef9-476e-839f-2e057a712693]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:51 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b Sep 17 07:27:51 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:52 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b" returned: 0 in 0.913s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:52 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 Sep 17 07:27:52 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:52 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622" returned: 0 in 0.583s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:52 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622 Sep 17 07:27:52 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:53 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b.6d9049a3-aa6e-4497-b1f7-680086191622" returned: 0 in 0.367s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-quobyte-6d9049a3-aa6e-4497-b1f7-680086191622" released by "_delete_snapshot" :: held 2.508s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-quobyte-1a41406e-d1dc-4949-96e1-f69407f9125b" released by "delete_snapshot" :: held 2.536s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:53 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Created reservations ['e167770b-a994-4975-9ecc-31a83cf57790', 'fef97f1a-80fc-4e87-b260-64c4c51b9fc6', 'b0bcb1ec-7264-45d3-b344-5a276db443b5', '7b5d837b-0290-4cfb-bf85-01b76ebb4151'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:53 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Delete snapshot completed successfully. Sep 17 07:27:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-36caea24-739c-4f6c-8edc-9159abf6481e tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-6d9049a3-aa6e-4497-b1f7-680086191622-delete_snapshot" released by "delete_snapshot" :: held 2.740s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "cinder-1a41406e-d1dc-4949-96e1-f69407f9125b-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-1a41406e-d1dc-4949-96e1-f69407f9125b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "cinder-quobyte-1a41406e-d1dc-4949-96e1-f69407f9125b" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-quobyte-1a41406e-d1dc-4949-96e1-f69407f9125b" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:54 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59d32bb-2a55-4492-b3b1-5cbe89d8df1c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:54 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b Sep 17 07:27:54 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:54 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b" returned: 0 in 0.613s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:54 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b Sep 17 07:27:54 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:55 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1a41406e-d1dc-4949-96e1-f69407f9125b" returned: 0 in 0.304s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-quobyte-1a41406e-d1dc-4949-96e1-f69407f9125b" released by "delete_volume" :: held 1.049s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:55 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Created reservations ['41032e72-d8f1-4354-ac21-a4780689f47c', '53c78213-f176-4beb-8b89-32d56fb74ec8', '2d1dc013-54a9-494a-ac5d-d9180f88b072', 'a6e1270f-abd9-429a-8ec3-df47e1fed06c'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:55 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:27:55 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:55 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.356s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:55 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:27:55 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Deleted volume successfully. Sep 17 07:27:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1d044ac5-b129-4416-9f8f-7a878a414a5a tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-1a41406e-d1dc-4949-96e1-f69407f9125b-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "cinder-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "cinder-quobyte-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-quobyte-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3" acquired by "delete_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:56 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d365f2-c93b-4d90-8fae-2d43e9870b06]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:56 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3 Sep 17 07:27:56 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:57 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3" returned: 0 in 0.582s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:57 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3 Sep 17 07:27:57 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:57 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3" returned: 0 in 0.332s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-quobyte-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3" released by "delete_volume" :: held 0.985s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:57 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Created reservations ['924e7045-5749-4eee-bffb-325050bd4ac3', 'db7fa66b-7130-402c-b0ea-4cd570eb3741', '4c44abfa-1ff2-4262-adf0-8bffa3665543', 'd9e05d6b-f70e-4129-b29c-c0acc548b9d4'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:27:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:57 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:27:57 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:58 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5" returned: 0 in 6.975s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9, size 1024.00 MB, duration 6.98 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:27:58 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Converted 1024.00 MB image at 146.78 MB/s Sep 17 07:27:58 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5 is being set with open permissions: ugo+rw Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:58 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.436s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:27:58 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5 Sep 17 07:27:58 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Deleted volume successfully. Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6fb8af79-ae48-4250-867b-8d8864047fda tempest-VolumeDependencyTests-2081443521 None] Lock "cinder-05ff13db-2c30-4641-aadc-1e2fe0e0e3b3-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:58 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5" returned: 0 in 0.241s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-d6ea4242-363e-444e-9b1c-cde1ede031c5" released by "_copy_volume_from_snapshot" :: held 8.195s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-817c0fe6-580d-4103-a2e7-98414268f3e7-d6ea4242-363e-444e-9b1c-cde1ede031c5" released by "_create_volume_from_snapshot" :: held 8.263s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.286s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1215690732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120e84f1-6996-4960-ab18-ce701b600c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d140f6a195b4cae8559456598ffe674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:44Z,use_quota=True,user_id='b522dbf60cff4eb0acc8eb8e1ac5debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Creating volume 120e84f1-6996-4960-ab18-ce701b600c33 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:27:58 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-120e84f1-6996-4960-ab18-ce701b600c33 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:58 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-120e84f1-6996-4960-ab18-ce701b600c33 1073741824 Sep 17 07:27:58 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d83c5e-42b7-4274-8fd1-5f50ffa3e66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6ea4242-363e-444e-9b1c-cde1ede031c5', 'volume_size': 1, 'snapshot_id': '817c0fe6-580d-4103-a2e7-98414268f3e7'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfd3cce-daf7-4ee5-842e-69be0ba34d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:58 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Volume volume-d6ea4242-363e-444e-9b1c-cde1ede031c5 (d6ea4242-363e-444e-9b1c-cde1ede031c5): created successfully Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfd3cce-daf7-4ee5-842e-69be0ba34d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Flow 'volume_create_manager' (4221b823-5db7-4fd8-ad6f-700e75845d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3ee1bfec-76af-4a26-bf19-5bab15399f02 tempest-VolumesDeleteCascade-2121916583 None] Created volume successfully. Sep 17 07:27:58 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-120e84f1-6996-4960-ab18-ce701b600c33 1073741824" returned: 0 in 0.485s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-120e84f1-6996-4960-ab18-ce701b600c33 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:58 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-120e84f1-6996-4960-ab18-ce701b600c33 Sep 17 07:27:58 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Performing cascade delete. {{(pid=86029) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 07:27:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-817c0fe6-580d-4103-a2e7-98414268f3e7-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-817c0fe6-580d-4103-a2e7-98414268f3e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-quobyte-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-quobyte-817c0fe6-580d-4103-a2e7-98414268f3e7" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-817c0fe6-580d-4103-a2e7-98414268f3e7" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Deleting offline snapshot 817c0fe6-580d-4103-a2e7-98414268f3e7 of volume 8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] snapshot_file for this snap is: volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc522789-bd62-43cc-bdf9-3c778f86a01a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:59 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-120e84f1-6996-4960-ab18-ce701b600c33" returned: 0 in 0.311s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.992s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-654316210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046268d4-a7a9-4785-b65e-df5fbf226a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222ecbce78af4ee4adff6f5656f15376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:27:51Z,use_quota=True,user_id='46072bdf65b046fca6956706f1c4e0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Creating volume 046268d4-a7a9-4785-b65e-df5fbf226a3a {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:27:59 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-046268d4-a7a9-4785-b65e-df5fbf226a3a 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810e38b7-51d1-4cce-9ba6-186be36ba582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-120e84f1-6996-4960-ab18-ce701b600c33', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2cd5e6-5154-4db2-a1f6-28b05ea61333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:27:59 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-046268d4-a7a9-4785-b65e-df5fbf226a3a 1073741824 Sep 17 07:27:59 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:59 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Volume volume-120e84f1-6996-4960-ab18-ce701b600c33 (120e84f1-6996-4960-ab18-ce701b600c33): created successfully Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2cd5e6-5154-4db2-a1f6-28b05ea61333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Flow 'volume_create_manager' (de80b00f-c81d-4d32-8ff8-20041ae545be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:27:59 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 Sep 17 07:27:59 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:59 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-5e22cab9-a9d4-499a-82de-ef0828051fa4 tempest-VolumeQuotasAdminTestJSON-933324113 None] Created volume successfully. Sep 17 07:27:59 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7" returned: 0 in 0.455s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[649c0841-c094-4df1-8d56-224c66fd3289]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:59 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-046268d4-a7a9-4785-b65e-df5fbf226a3a 1073741824" returned: 0 in 0.584s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:27:59 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 Sep 17 07:27:59 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-046268d4-a7a9-4785-b65e-df5fbf226a3a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:27:59 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-046268d4-a7a9-4785-b65e-df5fbf226a3a Sep 17 07:27:59 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:00 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-046268d4-a7a9-4785-b65e-df5fbf226a3a" returned: 0 in 0.273s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:28:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26481286-542a-4810-b1e8-ea76a9bffa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-046268d4-a7a9-4785-b65e-df5fbf226a3a', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497031a0-dee7-4f2a-9cc3-9337892b3be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:00 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Volume volume-046268d4-a7a9-4785-b65e-df5fbf226a3a (046268d4-a7a9-4785-b65e-df5fbf226a3a): created successfully Sep 17 07:28:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497031a0-dee7-4f2a-9cc3-9337892b3be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Flow 'volume_create_manager' (15b5a33c-dbe7-4da8-803f-e166e8b86103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-ac30e20b-f14b-4ccb-8107-1d81347a27c3 tempest-VolumesTransfersV355Test-544865439 None] Created volume successfully. Sep 17 07:28:00 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9" returned: 0 in 0.646s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:00 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 Sep 17 07:28:00 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:00 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7" returned: 0 in 0.356s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:00 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7 Sep 17 07:28:00 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:00 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9.817c0fe6-580d-4103-a2e7-98414268f3e7" returned: 0 in 0.285s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-817c0fe6-580d-4103-a2e7-98414268f3e7" released by "_delete_snapshot" :: held 1.891s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9" released by "delete_snapshot" :: held 1.938s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-7c1dfcac-72c1-416f-a6d3-1aa8cc89bbf3 tempest-VolumeQuotasAdminTestJSON-854132208 None] Transfer volume completed successfully. Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Created reservations ['219943a0-1092-465c-afc0-1b230abd0fe4', 'd4b8ec2e-d11d-46f6-98db-3bb33553bae1', 'df47de57-f526-40e1-9263-ba6fc2bbaf51', '4199a766-70a8-4a7c-9782-75a6b51b9ba3'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Delete snapshot completed successfully. Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-817c0fe6-580d-4103-a2e7-98414268f3e7-delete_snapshot" released by "delete_snapshot" :: held 2.179s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Snapshots deleted, issuing volume delete {{(pid=86029) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-quobyte-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c930a7a9-030c-40a1-8ffd-5e5e849b5578]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:01 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 Sep 17 07:28:01 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Acquiring lock "cinder-120e84f1-6996-4960-ab18-ce701b600c33-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Lock "cinder-120e84f1-6996-4960-ab18-ce701b600c33-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:01 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9" returned: 0 in 0.443s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Acquiring lock "cinder-quobyte-120e84f1-6996-4960-ab18-ce701b600c33" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:01 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9 Sep 17 07:28:01 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Lock "cinder-quobyte-120e84f1-6996-4960-ab18-ce701b600c33" acquired by "delete_volume" :: waited 0.030s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[db455152-4f72-49b4-b248-f398ea5fe0f7]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-120e84f1-6996-4960-ab18-ce701b600c33 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:01 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-120e84f1-6996-4960-ab18-ce701b600c33 Sep 17 07:28:01 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:02 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3ce7564b-654c-4d3c-9901-b18deef13d47 tempest-VolumesTransfersV355Test-484709701 None] Transfer volume completed successfully. Sep 17 07:28:02 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9" returned: 0 in 0.332s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9" released by "delete_volume" :: held 0.889s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Created reservations ['77656ff0-0ed7-460c-8107-833177693f80', '0688c450-75b2-4759-a067-6546733726e1', '5c0463f9-45a9-4814-99ee-3244dff2ae8f', '3924ca9d-6050-46c3-affb-a142d0fa2c9e'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:02 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-120e84f1-6996-4960-ab18-ce701b600c33" returned: 0 in 0.481s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-120e84f1-6996-4960-ab18-ce701b600c33 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:02 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:02 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:02 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-120e84f1-6996-4960-ab18-ce701b600c33 Sep 17 07:28:02 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:02 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.334s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:02 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:02 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Deleted volume successfully. Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-120e84f1-6996-4960-ab18-ce701b600c33" returned: 0 in 0.319s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Lock "cinder-quobyte-120e84f1-6996-4960-ab18-ce701b600c33" released by "delete_volume" :: held 0.859s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0c91d22a-48ca-4190-bf4d-9445245811dd tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-8341532d-ddf5-4d6b-a0ea-d16e3a9267b9-delete_volume" released by "delete_volume" :: held 3.763s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Created reservations ['9de9fb45-b579-4dd6-a835-ec8948f0964e', '544ed160-93df-4ef7-8bd8-bf51b07f6ee3', 'ab27513c-84f7-4d83-83cb-6d66b279e19e', '90c8db66-bf14-46c3-bf6d-83c91dc75f02'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Acquiring lock "cinder-046268d4-a7a9-4785-b65e-df5fbf226a3a-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Lock "cinder-046268d4-a7a9-4785-b65e-df5fbf226a3a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:02 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:02 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Acquiring lock "cinder-quobyte-046268d4-a7a9-4785-b65e-df5fbf226a3a" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-d6ea4242-363e-444e-9b1c-cde1ede031c5-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:02 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Flow 'volume_create_manager' (5dd940cc-be1b-49f0-b455-253f9f8e1e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb3dd03-0898-410f-8ee1-7852b444a811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Lock "cinder-quobyte-046268d4-a7a9-4785-b65e-df5fbf226a3a" acquired by "delete_volume" :: waited 0.147s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb3dd03-0898-410f-8ee1-7852b444a811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1974770673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a800db-c0b4-4072-9838-25bd6f868ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5477f3e7f6f24c2fa6441049f21ee85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:03Z,use_quota=True,user_id='717cf06062fb4c32974e6c99204e6feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ddfbc8-fe2e-4baa-a497-0a8c2d3668fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ddfbc8-fe2e-4baa-a497-0a8c2d3668fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7cce82-cc49-4b56-9c9e-f62aa9fb1ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7cce82-cc49-4b56-9c9e-f62aa9fb1ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a800db-c0b4-4072-9838-25bd6f868ea3', 'volume_name': 'volume-80a800db-c0b4-4072-9838-25bd6f868ea3', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d69d80e-f8d0-490f-b3b0-87af91c1eeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:03 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d69d80e-f8d0-490f-b3b0-87af91c1eeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c7f71b-7a1d-42c2-9284-f0bc29cff048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:03 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Volume 80a800db-c0b4-4072-9838-25bd6f868ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a800db-c0b4-4072-9838-25bd6f868ea3', 'volume_size': 1} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1974770673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a800db-c0b4-4072-9838-25bd6f868ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5477f3e7f6f24c2fa6441049f21ee85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:03Z,use_quota=True,user_id='717cf06062fb4c32974e6c99204e6feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Creating volume 80a800db-c0b4-4072-9838-25bd6f868ea3 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:28:03 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-80a800db-c0b4-4072-9838-25bd6f868ea3 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67c5e0f-a346-4ab3-83ea-8f803fd7560f]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-d6ea4242-363e-444e-9b1c-cde1ede031c5-delete_volume" acquired by "delete_volume" :: waited 0.218s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-046268d4-a7a9-4785-b65e-df5fbf226a3a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:03 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-80a800db-c0b4-4072-9838-25bd6f868ea3 1073741824 Sep 17 07:28:03 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.332s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:03 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Deleted volume successfully. Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "cinder-quobyte-d6ea4242-363e-444e-9b1c-cde1ede031c5" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-22f30b2a-f8b6-45a1-9b6e-213e06b9a887 tempest-VolumeQuotasAdminTestJSON-423602717 None] Lock "cinder-120e84f1-6996-4960-ab18-ce701b600c33-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-d6ea4242-363e-444e-9b1c-cde1ede031c5" acquired by "delete_volume" :: waited 0.033s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcec219e-f01a-48f7-a063-779485b90e8b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:03 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-046268d4-a7a9-4785-b65e-df5fbf226a3a Sep 17 07:28:03 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:03 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5 Sep 17 07:28:03 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:03 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-046268d4-a7a9-4785-b65e-df5fbf226a3a" returned: 0 in 0.479s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-046268d4-a7a9-4785-b65e-df5fbf226a3a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:03 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-80a800db-c0b4-4072-9838-25bd6f868ea3 1073741824" returned: 0 in 0.515s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:03 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-046268d4-a7a9-4785-b65e-df5fbf226a3a Sep 17 07:28:03 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-80a800db-c0b4-4072-9838-25bd6f868ea3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:03 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-80a800db-c0b4-4072-9838-25bd6f868ea3 Sep 17 07:28:03 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:03 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5" returned: 0 in 0.517s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:03 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5 Sep 17 07:28:03 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:04 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-046268d4-a7a9-4785-b65e-df5fbf226a3a" returned: 0 in 0.338s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:04 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Lock "cinder-quobyte-046268d4-a7a9-4785-b65e-df5fbf226a3a" released by "delete_volume" :: held 0.943s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-80a800db-c0b4-4072-9838-25bd6f868ea3" returned: 0 in 0.303s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c7f71b-7a1d-42c2-9284-f0bc29cff048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a800db-c0b4-4072-9838-25bd6f868ea3', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cc40f2-38eb-4ec0-85c0-e9d90552bfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:04 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Volume volume-80a800db-c0b4-4072-9838-25bd6f868ea3 (80a800db-c0b4-4072-9838-25bd6f868ea3): created successfully Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cc40f2-38eb-4ec0-85c0-e9d90552bfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Flow 'volume_create_manager' (5dd940cc-be1b-49f0-b455-253f9f8e1e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:04 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-370e4f97-122e-466f-a449-06d000193a79 tempest-ProjectReaderTests-536817993 None] Created volume successfully. Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Created reservations ['444ae229-1d01-454f-8e45-75843eb34540', 'd4740940-428b-4ac9-b3f6-687465089503', '5e9268c0-ec4e-46d2-a20e-3db3dff76a9e', '52ca7e37-cc31-445a-bb41-73be36ba8ece'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:04 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d6ea4242-363e-444e-9b1c-cde1ede031c5" returned: 0 in 0.331s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-quobyte-d6ea4242-363e-444e-9b1c-cde1ede031c5" released by "delete_volume" :: held 0.903s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Created reservations ['623dcf52-2367-4ccd-bdf6-00f91477dd22', '449874a1-d3af-4341-925b-8ac4256a9b0a', '3e3a5eef-ac9a-42d4-924c-a2524e246957', '05e324cf-48d4-4907-96b7-014f63dac229'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:04 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:04 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:04 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:04 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:04 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.307s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:04 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Deleted volume successfully. Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-71b681a4-88f5-48ff-8090-19af97b4d13f tempest-VolumesTransfersV355Test-1663965718 None] Lock "cinder-046268d4-a7a9-4785-b65e-df5fbf226a3a-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:04 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.294s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:04 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Deleted volume successfully. Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-548ede95-48a5-4f98-a80d-2530bf42609b tempest-VolumesDeleteCascade-2121916583 None] Lock "cinder-d6ea4242-363e-444e-9b1c-cde1ede031c5-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:04 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:04 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:05 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.284s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Acquiring lock "cinder-80a800db-c0b4-4072-9838-25bd6f868ea3-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Lock "cinder-80a800db-c0b4-4072-9838-25bd6f868ea3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Acquiring lock "cinder-quobyte-80a800db-c0b4-4072-9838-25bd6f868ea3" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Lock "cinder-quobyte-80a800db-c0b4-4072-9838-25bd6f868ea3" acquired by "delete_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ed15c0-ea3c-4ad4-8e70-1aa17709c783]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-80a800db-c0b4-4072-9838-25bd6f868ea3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:05 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-80a800db-c0b4-4072-9838-25bd6f868ea3 Sep 17 07:28:05 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Flow 'volume_create_manager' (b5c52719-12ca-4b46-97b6-0e3e77403c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba1528b-930b-4a33-b8b2-eb5101a02604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba1528b-930b-4a33-b8b2-eb5101a02604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1717494203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da98e42-7c2e-47a3-bb0f-16cd263721aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222ecbce78af4ee4adff6f5656f15376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:06Z,use_quota=True,user_id='46072bdf65b046fca6956706f1c4e0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d14570-237e-4da9-8969-1700e0ba5736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d14570-237e-4da9-8969-1700e0ba5736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033cc6b6-4e90-4dc9-9479-44e0a379c29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033cc6b6-4e90-4dc9-9479-44e0a379c29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5da98e42-7c2e-47a3-bb0f-16cd263721aa', 'volume_name': 'volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba63b98-73be-46f4-8174-41acbb786053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba63b98-73be-46f4-8174-41acbb786053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21bc106-93a6-4ebe-919a-31fedd8454ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:05 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Volume 5da98e42-7c2e-47a3-bb0f-16cd263721aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa', 'volume_size': 1} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1717494203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da98e42-7c2e-47a3-bb0f-16cd263721aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222ecbce78af4ee4adff6f5656f15376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:06Z,use_quota=True,user_id='46072bdf65b046fca6956706f1c4e0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Creating volume 5da98e42-7c2e-47a3-bb0f-16cd263721aa {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:28:05 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:05 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa 1073741824 Sep 17 07:28:05 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:05 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-80a800db-c0b4-4072-9838-25bd6f868ea3" returned: 0 in 0.438s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-80a800db-c0b4-4072-9838-25bd6f868ea3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:06 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-80a800db-c0b4-4072-9838-25bd6f868ea3 Sep 17 07:28:06 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:06 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-80a800db-c0b4-4072-9838-25bd6f868ea3" returned: 0 in 0.379s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Lock "cinder-quobyte-80a800db-c0b4-4072-9838-25bd6f868ea3" released by "delete_volume" :: held 0.905s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:06 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa 1073741824" returned: 0 in 0.571s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Created reservations ['3ca6a7a2-54a3-465a-ba2c-e5e53c8fbf67', 'eb0de779-58d3-44aa-903c-cec3007eea22', '1bc9e1da-58c7-45eb-ac6a-e4f452e41ce5', '1fa18115-22d4-4178-b97c-6dddd5ea660f'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:06 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa Sep 17 07:28:06 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:06 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:06 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:06 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa" returned: 0 in 0.317s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21bc106-93a6-4ebe-919a-31fedd8454ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce42f1f8-1b4e-4ff9-97d5-2de1c8cba5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:06 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Volume volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa (5da98e42-7c2e-47a3-bb0f-16cd263721aa): created successfully Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce42f1f8-1b4e-4ff9-97d5-2de1c8cba5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Flow 'volume_create_manager' (b5c52719-12ca-4b46-97b6-0e3e77403c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:06 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-c9e343a7-376e-489b-9a63-927df1bdfcf0 tempest-VolumesTransfersV355Test-544865439 None] Created volume successfully. Sep 17 07:28:06 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.309s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:06 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Deleted volume successfully. Sep 17 07:28:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-053fc12f-00e3-403c-b55d-2413bae51078 tempest-ProjectReaderTests-536817993 None] Lock "cinder-80a800db-c0b4-4072-9838-25bd6f868ea3-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Acquiring lock "cinder-5da98e42-7c2e-47a3-bb0f-16cd263721aa-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Lock "cinder-5da98e42-7c2e-47a3-bb0f-16cd263721aa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Acquiring lock "cinder-quobyte-5da98e42-7c2e-47a3-bb0f-16cd263721aa" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Lock "cinder-quobyte-5da98e42-7c2e-47a3-bb0f-16cd263721aa" acquired by "delete_volume" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Flow 'volume_create_manager' (ad0ec8c3-e0ca-4df8-ba64-995f73aff9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32947dda-6c6a-4a96-ae35-6ecfae3d9b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[515f48f4-e2d3-4507-97d3-be58c16c2c08]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32947dda-6c6a-4a96-ae35-6ecfae3d9b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580561868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee8335e-7295-4261-b49e-063241ce7e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5477f3e7f6f24c2fa6441049f21ee85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:08Z,use_quota=True,user_id='717cf06062fb4c32974e6c99204e6feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c68f130-d83a-4512-97d9-a85db3049322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c68f130-d83a-4512-97d9-a85db3049322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8a5436-b288-4e7d-a0b1-a717241ff5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8a5436-b288-4e7d-a0b1-a717241ff5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee8335e-7295-4261-b49e-063241ce7e7a', 'volume_name': 'volume-6ee8335e-7295-4261-b49e-063241ce7e7a', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02729173-7fb1-4287-b4fc-56d84253431e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02729173-7fb1-4287-b4fc-56d84253431e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab4fc7e-f2b7-4c6b-a06a-e6ffbee3793d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:08 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Volume 6ee8335e-7295-4261-b49e-063241ce7e7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee8335e-7295-4261-b49e-063241ce7e7a', 'volume_size': 1} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580561868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee8335e-7295-4261-b49e-063241ce7e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5477f3e7f6f24c2fa6441049f21ee85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:08Z,use_quota=True,user_id='717cf06062fb4c32974e6c99204e6feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Creating volume 6ee8335e-7295-4261-b49e-063241ce7e7a {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:28:08 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6ee8335e-7295-4261-b49e-063241ce7e7a 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:08 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa Sep 17 07:28:08 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:08 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6ee8335e-7295-4261-b49e-063241ce7e7a 1073741824 Sep 17 07:28:08 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:08 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa" returned: 0 in 0.477s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:08 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa Sep 17 07:28:08 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:09 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6ee8335e-7295-4261-b49e-063241ce7e7a 1073741824" returned: 0 in 0.605s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6ee8335e-7295-4261-b49e-063241ce7e7a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:09 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6ee8335e-7295-4261-b49e-063241ce7e7a Sep 17 07:28:09 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:09 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5da98e42-7c2e-47a3-bb0f-16cd263721aa" returned: 0 in 0.400s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Lock "cinder-quobyte-5da98e42-7c2e-47a3-bb0f-16cd263721aa" released by "delete_volume" :: held 0.973s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Created reservations ['c65e0b11-0262-46d7-9935-4351e5840a4c', 'a7c1ded3-617b-49e6-99e4-247b87a92dcc', '34fd0222-2542-4147-9ae1-4105cfcaf5ea', 'bb2d31a4-bc5a-4d95-8e12-1c8149cf1ede'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:09 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6ee8335e-7295-4261-b49e-063241ce7e7a" returned: 0 in 0.311s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:09 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:09 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab4fc7e-f2b7-4c6b-a06a-e6ffbee3793d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee8335e-7295-4261-b49e-063241ce7e7a', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f24caa6-4ab5-4f36-86e9-998c458ec12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:09 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Volume volume-6ee8335e-7295-4261-b49e-063241ce7e7a (6ee8335e-7295-4261-b49e-063241ce7e7a): created successfully Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f24caa6-4ab5-4f36-86e9-998c458ec12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Flow 'volume_create_manager' (ad0ec8c3-e0ca-4df8-ba64-995f73aff9d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:09 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8a0eaa11-abec-48bd-97d2-824750db2abd tempest-ProjectReaderTests-536817993 None] Created volume successfully. Sep 17 07:28:09 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.272s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:09 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Deleted volume successfully. Sep 17 07:28:09 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6f9fae33-9d28-44d0-915b-3f04644e7df0 tempest-VolumesTransfersV355Test-1663965718 None] Lock "cinder-5da98e42-7c2e-47a3-bb0f-16cd263721aa-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Flow 'volume_create_manager' (5291c379-a498-46dc-9544-86737c231799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90608c74-228f-403f-863f-064e60f04dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90608c74-228f-403f-863f-064e60f04dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1033130205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbec094-a4f6-44a6-b8b2-388c5fd1874c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4aa68fef9541d88ee3198db99a9f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:10Z,use_quota=True,user_id='329e48c8b755418cb88f11836bdb4da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e548146e-4ba4-4928-a73e-047441def9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e548146e-4ba4-4928-a73e-047441def9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614d62f4-1fa5-42e2-998e-63e301b37647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614d62f4-1fa5-42e2-998e-63e301b37647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dbec094-a4f6-44a6-b8b2-388c5fd1874c', 'volume_name': 'volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bef36e1-975d-4b83-9656-617ee4638f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bef36e1-975d-4b83-9656-617ee4638f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ab95fa-cab4-442b-977c-91b9774f7252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:10 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Volume 9dbec094-a4f6-44a6-b8b2-388c5fd1874c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c', 'volume_size': 1} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1033130205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbec094-a4f6-44a6-b8b2-388c5fd1874c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f4aa68fef9541d88ee3198db99a9f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:10Z,use_quota=True,user_id='329e48c8b755418cb88f11836bdb4da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Creating volume 9dbec094-a4f6-44a6-b8b2-388c5fd1874c {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:28:10 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:10 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c 1073741824 Sep 17 07:28:10 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Acquiring lock "cinder-6ee8335e-7295-4261-b49e-063241ce7e7a-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Lock "cinder-6ee8335e-7295-4261-b49e-063241ce7e7a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Acquiring lock "cinder-quobyte-6ee8335e-7295-4261-b49e-063241ce7e7a" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Lock "cinder-quobyte-6ee8335e-7295-4261-b49e-063241ce7e7a" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[171c43ac-27a2-47ba-a9e7-d06c4a9cd901]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6ee8335e-7295-4261-b49e-063241ce7e7a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:10 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6ee8335e-7295-4261-b49e-063241ce7e7a Sep 17 07:28:10 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:10 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c 1073741824" returned: 0 in 0.535s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:10 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c Sep 17 07:28:10 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:10 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6ee8335e-7295-4261-b49e-063241ce7e7a" returned: 0 in 0.396s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6ee8335e-7295-4261-b49e-063241ce7e7a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:10 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6ee8335e-7295-4261-b49e-063241ce7e7a Sep 17 07:28:10 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:11 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c" returned: 0 in 0.345s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ab95fa-cab4-442b-977c-91b9774f7252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43874f1-d7a6-43f5-8ae4-41b3cd1b64d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:11 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Volume volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c (9dbec094-a4f6-44a6-b8b2-388c5fd1874c): created successfully Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43874f1-d7a6-43f5-8ae4-41b3cd1b64d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Flow 'volume_create_manager' (5291c379-a498-46dc-9544-86737c231799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:11 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cc55f366-d580-4b78-9545-f13e29175fc8 tempest-VolumesMetadataTest-199240805 None] Created volume successfully. Sep 17 07:28:11 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6ee8335e-7295-4261-b49e-063241ce7e7a" returned: 0 in 0.331s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Lock "cinder-quobyte-6ee8335e-7295-4261-b49e-063241ce7e7a" released by "delete_volume" :: held 0.791s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Created reservations ['a9de259d-c73d-46fe-a692-c186d2602e81', 'fd9486b3-0328-46eb-ba14-2394a2e01821', '97b67dc0-7a95-45bd-a158-388a1192bd5e', 'f7993a9f-a421-4a5d-b7a3-f803778d5efc'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:11 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:11 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:11 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.286s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:11 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Deleted volume successfully. Sep 17 07:28:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a93745db-6f92-435c-9e7e-5584e9fc7748 tempest-ProjectReaderTests-536817993 None] Lock "cinder-6ee8335e-7295-4261-b49e-063241ce7e7a-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Flow 'volume_create_manager' (bfabb1a8-c95e-4dc2-8670-9e1f853f0f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160d67e0-ea65-4a4f-b67d-38e386292c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160d67e0-ea65-4a4f-b67d-38e386292c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-580153167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee861ea-8f85-4c25-8bcc-157383e54c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7768fb5faa8b4407b185bad74d989c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:12Z,use_quota=True,user_id='f33c03884eaf4411885f85676ddc55d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a5c612-f232-4d66-8eaf-617964b4a182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a5c612-f232-4d66-8eaf-617964b4a182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6c2e18-f892-43d5-97b0-4f4dfd80bfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6c2e18-f892-43d5-97b0-4f4dfd80bfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee861ea-8f85-4c25-8bcc-157383e54c98', 'volume_name': 'volume-2ee861ea-8f85-4c25-8bcc-157383e54c98', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b65f318-0af6-4c32-81fb-03a630a6d960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b65f318-0af6-4c32-81fb-03a630a6d960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb47119c-b213-4131-b2a1-30bc4e767b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:12 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Volume 2ee861ea-8f85-4c25-8bcc-157383e54c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee861ea-8f85-4c25-8bcc-157383e54c98', 'volume_size': 1} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-580153167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee861ea-8f85-4c25-8bcc-157383e54c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7768fb5faa8b4407b185bad74d989c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:12Z,use_quota=True,user_id='f33c03884eaf4411885f85676ddc55d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Creating volume 2ee861ea-8f85-4c25-8bcc-157383e54c98 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:28:12 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:12 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 1073741824 Sep 17 07:28:12 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:12 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 1073741824" returned: 0 in 0.559s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:12 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 Sep 17 07:28:12 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:13 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98" returned: 0 in 0.295s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:13 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:28:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:13 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb47119c-b213-4131-b2a1-30bc4e767b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee861ea-8f85-4c25-8bcc-157383e54c98', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:13 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ff57b8-465d-4935-a1a0-f41f6750a14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:13 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Volume volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 (2ee861ea-8f85-4c25-8bcc-157383e54c98): created successfully Sep 17 07:28:13 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ff57b8-465d-4935-a1a0-f41f6750a14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:13 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Flow 'volume_create_manager' (bfabb1a8-c95e-4dc2-8670-9e1f853f0f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:13 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2f00a681-371d-4b6b-9179-cd6106a27bc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Created volume successfully. Sep 17 07:28:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Acquiring lock "cinder-9dbec094-a4f6-44a6-b8b2-388c5fd1874c-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Lock "cinder-9dbec094-a4f6-44a6-b8b2-388c5fd1874c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Acquiring lock "cinder-quobyte-9dbec094-a4f6-44a6-b8b2-388c5fd1874c" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Lock "cinder-quobyte-9dbec094-a4f6-44a6-b8b2-388c5fd1874c" acquired by "delete_volume" :: waited 0.013s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:13 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6efa9b7-5e9a-4f18-a5f4-230230d7b3b1]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:14 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c Sep 17 07:28:14 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:14 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c" returned: 0 in 0.464s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:14 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c Sep 17 07:28:14 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Creating offline snapshot ce4fb9cc-410e-4642-af55-988a54240b49 of volume 2ee861ea-8f85-4c25-8bcc-157383e54c98 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b678f836-8373-43f2-9bd4-0a1e1f4c55be]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:14 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9dbec094-a4f6-44a6-b8b2-388c5fd1874c" returned: 0 in 0.331s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Lock "cinder-quobyte-9dbec094-a4f6-44a6-b8b2-388c5fd1874c" released by "delete_volume" :: held 0.860s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:14 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 Sep 17 07:28:14 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Created reservations ['e7cc6683-251f-4ba1-bec0-68501f3c1ce8', 'f56165c7-3641-433b-8a1b-337fb58c2d62', 'db1c83fa-9748-4df4-9e99-27322f750263', '38c6b97f-e78d-4dba-bbc4-ac489aeef5e9'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:14 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:14 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:15 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98" returned: 0 in 0.496s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:15 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 1G Sep 17 07:28:15 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:15 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.372s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:15 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:15 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Deleted volume successfully. Sep 17 07:28:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f068a08-a830-4e79-a6ce-b25673497946 tempest-VolumesMetadataTest-199240805 None] Lock "cinder-9dbec094-a4f6-44a6-b8b2-388c5fd1874c-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:15 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 1G" returned: 0 in 0.633s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:15 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 Sep 17 07:28:15 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:16 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49" returned: 0 in 0.431s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:16 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 is being set with open permissions: ugo+rw Sep 17 07:28:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:16 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 Sep 17 07:28:16 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:16 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49" returned: 0 in 0.363s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:16 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.info Sep 17 07:28:16 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:17 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.info" returned: 0 in 0.428s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:17 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.info is being set with open permissions: ugo+rw Sep 17 07:28:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:17 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.info Sep 17 07:28:17 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:17 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.info" returned: 0 in 0.329s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.825s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:17 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3b5b6ec4-82a2-4c31-8aa7-818052cd944b tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Create snapshot completed successfully Sep 17 07:28:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Acquiring lock "cinder-ce4fb9cc-410e-4642-af55-988a54240b49-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "cinder-ce4fb9cc-410e-4642-af55-988a54240b49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Acquiring lock "cinder-quobyte-2ee861ea-8f85-4c25-8bcc-157383e54c98" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "cinder-quobyte-2ee861ea-8f85-4c25-8bcc-157383e54c98" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Acquiring lock "cinder-quobyte-ce4fb9cc-410e-4642-af55-988a54240b49" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "cinder-quobyte-ce4fb9cc-410e-4642-af55-988a54240b49" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Deleting offline snapshot ce4fb9cc-410e-4642-af55-988a54240b49 of volume 2ee861ea-8f85-4c25-8bcc-157383e54c98 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:28:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] snapshot_file for this snap is: volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:28:18 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[373a2ef9-b404-4b44-aa72-3853eccb9064]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:18 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 Sep 17 07:28:18 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:18 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49" returned: 0 in 0.432s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee861ea-8f85-4c25-8bcc-157383e54c98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:28:18 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa802f60-7489-4e04-9fa7-6c6394fd2a1d]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:19 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 Sep 17 07:28:19 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Flow 'volume_create_manager' (277274f3-60de-4fa3-a654-fe73e77dab75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7378c93-4b1e-4f46-9d6b-b46c4f46de4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7378c93-4b1e-4f46-9d6b-b46c4f46de4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-400357731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc46e3ac-86c4-406a-a5b4-778e4066dad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b02de6312354609b693fea223c41af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:19Z,use_quota=True,user_id='985909baa55b4c11a365df1efb9d1e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3cba19-e635-4271-9764-93e2a240d2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3cba19-e635-4271-9764-93e2a240d2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d941d0f4-d79a-45a6-bf38-dcef975b9e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d941d0f4-d79a-45a6-bf38-dcef975b9e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc46e3ac-86c4-406a-a5b4-778e4066dad6', 'volume_name': 'volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989834e0-6b24-4133-8a99-b76b4c30e22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989834e0-6b24-4133-8a99-b76b4c30e22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:19 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00301e4-2209-4c72-9381-160a21318ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:19 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Volume dc46e3ac-86c4-406a-a5b4-778e4066dad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6', 'volume_size': 1} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-400357731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc46e3ac-86c4-406a-a5b4-778e4066dad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b02de6312354609b693fea223c41af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:19Z,use_quota=True,user_id='985909baa55b4c11a365df1efb9d1e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Creating volume dc46e3ac-86c4-406a-a5b4-778e4066dad6 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:28:19 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98" returned: 0 in 0.574s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:19 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 1073741824 Sep 17 07:28:19 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:19 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 Sep 17 07:28:19 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Flow 'volume_create_manager' (60c071bd-9519-4890-9e16-e20d0007c30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a31d1b-faa3-4063-9eaf-34061f55a914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a31d1b-faa3-4063-9eaf-34061f55a914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-367834571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17da8a44-ed42-4f1d-a2a5-494ee2f24197,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0b6070f8cf24924adbfd9857cda7e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:20Z,use_quota=True,user_id='d42d2fa4c87f46db9e6ba923994078cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:19 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71a3fa3-8ad1-4dd7-95b4-3e6294aa5075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71a3fa3-8ad1-4dd7-95b4-3e6294aa5075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0a1b30-f1e4-4aa7-bd06-c99a7164f73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0a1b30-f1e4-4aa7-bd06-c99a7164f73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17da8a44-ed42-4f1d-a2a5-494ee2f24197', 'volume_name': 'volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:20 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1572f64f-30bc-4632-91d5-28066734b5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1572f64f-30bc-4632-91d5-28066734b5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe31084-461c-417e-a1f7-f6f034e2071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:20 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Volume 17da8a44-ed42-4f1d-a2a5-494ee2f24197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197', 'volume_size': 1} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 1073741824" returned: 0 in 0.524s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49" returned: 0 in 0.501s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:20 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49 Sep 17 07:28:20 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:20 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 Sep 17 07:28:20 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:20 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98.ce4fb9cc-410e-4642-af55-988a54240b49" returned: 0 in 0.308s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:20 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6" returned: 0 in 0.311s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-367834571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17da8a44-ed42-4f1d-a2a5-494ee2f24197,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0b6070f8cf24924adbfd9857cda7e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:20Z,use_quota=True,user_id='d42d2fa4c87f46db9e6ba923994078cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Creating volume 17da8a44-ed42-4f1d-a2a5-494ee2f24197 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:28:20 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "cinder-quobyte-ce4fb9cc-410e-4642-af55-988a54240b49" released by "_delete_snapshot" :: held 1.999s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00301e4-2209-4c72-9381-160a21318ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:20 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197 1073741824 Sep 17 07:28:20 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d295303-e614-4ea3-bfcf-c6aefef8eb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "cinder-quobyte-2ee861ea-8f85-4c25-8bcc-157383e54c98" released by "delete_snapshot" :: held 2.053s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:20 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Volume volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 (dc46e3ac-86c4-406a-a5b4-778e4066dad6): created successfully Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d295303-e614-4ea3-bfcf-c6aefef8eb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Flow 'volume_create_manager' (277274f3-60de-4fa3-a654-fe73e77dab75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:20 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-86cdf3ec-235f-4d74-bf1c-18eee8ec7866 tempest-VolumesCloneTest-1972597541 None] Created volume successfully. Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Created reservations ['a8f348e5-2ab5-46fc-adf0-73e06f7bd1b7', 'a7b6f182-4e51-44ae-b8b7-93ec9dfa5c3f', 'afedf0fc-fd92-4153-be01-f995ed9fef99', 'e26be37d-bad1-4938-a97d-5816dcdf49f8'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:20 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Delete snapshot completed successfully. Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7be4887-4936-4b56-992f-60985ccdbf40 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "cinder-ce4fb9cc-410e-4642-af55-988a54240b49-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:20 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197 1073741824" returned: 0 in 0.479s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:20 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197 Sep 17 07:28:20 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:21 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197" returned: 0 in 0.249s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:28:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe31084-461c-417e-a1f7-f6f034e2071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc44d540-6d7b-4b07-be01-8c81937519dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:21 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Volume volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197 (17da8a44-ed42-4f1d-a2a5-494ee2f24197): created successfully Sep 17 07:28:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc44d540-6d7b-4b07-be01-8c81937519dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Flow 'volume_create_manager' (60c071bd-9519-4890-9e16-e20d0007c30e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:21 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3a0506f7-abe3-4c6e-83a3-827eaedde443 tempest-VolumesGetTest-353056408 None] Created volume successfully. Sep 17 07:28:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Acquiring lock "cinder-2ee861ea-8f85-4c25-8bcc-157383e54c98-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "cinder-2ee861ea-8f85-4c25-8bcc-157383e54c98-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Acquiring lock "cinder-quobyte-2ee861ea-8f85-4c25-8bcc-157383e54c98" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "cinder-quobyte-2ee861ea-8f85-4c25-8bcc-157383e54c98" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:21 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9685b932-616a-4901-9eb8-8798084add38]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:21 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:28:21 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 Sep 17 07:28:21 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Flow 'volume_create_manager' (66eadccb-f932-408e-8006-53a498a57cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f50ad2-20e1-4918-b7ea-894438f843c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f50ad2-20e1-4918-b7ea-894438f843c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-106864496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e0dd75-634b-4d83-997e-dad76e5a8dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b02de6312354609b693fea223c41af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=dc46e3ac-86c4-406a-a5b4-778e4066dad6,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:22Z,use_quota=True,user_id='985909baa55b4c11a365df1efb9d1e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee075765-4a5c-4d77-8dfa-69c3977ed1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee075765-4a5c-4d77-8dfa-69c3977ed1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2c110c-af77-4b9f-9da3-88b3e99d1b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2c110c-af77-4b9f-9da3-88b3e99d1b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '94e0dd75-634b-4d83-997e-dad76e5a8dd0', 'volume_name': 'volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0', 'volume_size': 2, 'source_volid': 'dc46e3ac-86c4-406a-a5b4-778e4066dad6', 'source_volstatus': 'available'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c51378-13fe-4cb4-a802-e89e18c14e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c51378-13fe-4cb4-a802-e89e18c14e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3563576f-d311-49d7-aa77-76e447f8ed41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:22 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Volume 94e0dd75-634b-4d83-997e-dad76e5a8dd0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0', 'volume_size': 2, 'source_volid': 'dc46e3ac-86c4-406a-a5b4-778e4066dad6', 'source_volstatus': 'available'} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:22 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Cloning volume dc46e3ac-86c4-406a-a5b4-778e4066dad6 to volume 94e0dd75-634b-4d83-997e-dad76e5a8dd0 Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Creating offline snapshot 3da2453a-9d56-4813-be32-93b81c16d7c6 of volume dc46e3ac-86c4-406a-a5b4-778e4066dad6 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33c4f62-6c06-4c90-b6e7-72d6daade3aa]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:22 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 Sep 17 07:28:22 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:22 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98" returned: 0 in 0.525s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:22 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98 Sep 17 07:28:22 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:22 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2ee861ea-8f85-4c25-8bcc-157383e54c98" returned: 0 in 0.310s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:22 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6" returned: 0 in 0.511s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "cinder-quobyte-2ee861ea-8f85-4c25-8bcc-157383e54c98" released by "delete_volume" :: held 0.978s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:22 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 1G Sep 17 07:28:22 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Created reservations ['8e019ccd-d73c-44f6-b506-5c64ad5d0e3d', 'd82cdf91-f4a4-428f-b046-8f60af2fe896', 'cbd1bcd8-7610-46e4-b058-c36e46330f59', '3bc1ae59-5e36-4a41-b6fc-7c3a365fa97f'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:22 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:22 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Flow 'volume_create_manager' (0b01b6c7-0b78-4c5e-8ffe-5f682722f906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e5f562-ce6a-4cbc-bc8b-2bb99be68dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e5f562-ce6a-4cbc-bc8b-2bb99be68dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-840024952',display_name='tempest-VolumesGetTest-Volume-1842008232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aac64e2-255f-429c-846d-22dbfebf63fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b6070f8cf24924adbfd9857cda7e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:23Z,use_quota=True,user_id='d42d2fa4c87f46db9e6ba923994078cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa66f558-8e91-4218-b4af-920279f6a025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa66f558-8e91-4218-b4af-920279f6a025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32454129-4ad8-4ad7-85f1-42ee4d1e989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32454129-4ad8-4ad7-85f1-42ee4d1e989d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aac64e2-255f-429c-846d-22dbfebf63fa', 'volume_name': 'volume-2aac64e2-255f-429c-846d-22dbfebf63fa', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8339b4-9f18-4cef-ba9b-c1e7dfb3533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8339b4-9f18-4cef-ba9b-c1e7dfb3533f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060dc63d-3934-48b9-9d13-775249e3d0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:23 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Volume 2aac64e2-255f-429c-846d-22dbfebf63fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aac64e2-255f-429c-846d-22dbfebf63fa', 'volume_size': 1} Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:23 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.376s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:23 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Deleted volume successfully. Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-629cf571-18a1-4fb0-9633-49777e0762a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-322179957 None] Lock "cinder-2ee861ea-8f85-4c25-8bcc-157383e54c98-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:23 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 1G" returned: 0 in 0.612s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:23 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 Sep 17 07:28:23 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:23 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6" returned: 0 in 0.336s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:23 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 is being set with open permissions: ugo+rw Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:23 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 Sep 17 07:28:23 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:23 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6" returned: 0 in 0.262s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:23 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.info Sep 17 07:28:23 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:24 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.info" returned: 0 in 0.295s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:24 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.info is being set with open permissions: ugo+rw Sep 17 07:28:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:24 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.info Sep 17 07:28:24 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:24 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.info" returned: 0 in 0.281s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Acquiring lock "cinder-quobyte-94e0dd75-634b-4d83-997e-dad76e5a8dd0" by "_copy_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Lock "cinder-quobyte-94e0dd75-634b-4d83-997e-dad76e5a8dd0" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] snapshot: 3da2453a-9d56-4813-be32-93b81c16d7c6, volume: 94e0dd75-634b-4d83-997e-dad76e5a8dd0, {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 07:28:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:24 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8def5cbc-d05f-4b9e-a673-7485ba870d18]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:24 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 Sep 17 07:28:24 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:25 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6" returned: 0 in 0.420s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:28:25 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d740d53f-b349-4be8-868c-db191e02ef8b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:25 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 Sep 17 07:28:25 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:25 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6" returned: 0 in 0.469s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] will copy from snapshot at /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 07:28:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Creating direct copy from snapshot {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 07:28:25 devstack cinder-volume[86029]: DEBUG cinder.utils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Path /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0 not found in is_blk_device check {{(pid=86029) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 07:28:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:25 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0 Sep 17 07:28:25 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:33 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0" returned: 0 in 8.396s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:33 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6, size 1024.00 MB, duration 8.40 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:28:33 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Converted 1024.00 MB image at 121.94 MB/s Sep 17 07:28:33 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0 is being set with open permissions: ugo+rw Sep 17 07:28:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:33 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0 Sep 17 07:28:33 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:34 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0" returned: 0 in 0.323s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Lock "cinder-quobyte-94e0dd75-634b-4d83-997e-dad76e5a8dd0" released by "_copy_volume_from_snapshot" :: held 9.717s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Acquiring lock "cinder-quobyte-3da2453a-9d56-4813-be32-93b81c16d7c6" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Lock "cinder-quobyte-3da2453a-9d56-4813-be32-93b81c16d7c6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:34 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Deleting offline snapshot 3da2453a-9d56-4813-be32-93b81c16d7c6 of volume dc46e3ac-86c4-406a-a5b4-778e4066dad6 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:28:34 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] snapshot_file for this snap is: volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:28:34 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[389aed51-2475-48c6-9169-933f858bb826]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:34 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 Sep 17 07:28:34 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:34 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6" returned: 0 in 0.397s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:34 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:28:34 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[df186cba-0188-4b27-8c6d-d98d307a9f77]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:34 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 Sep 17 07:28:34 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:35 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6" returned: 0 in 0.563s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:35 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 Sep 17 07:28:35 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:35 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6" returned: 0 in 0.339s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:35 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6 Sep 17 07:28:35 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:35 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6.3da2453a-9d56-4813-be32-93b81c16d7c6" returned: 0 in 0.273s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Lock "cinder-quobyte-3da2453a-9d56-4813-be32-93b81c16d7c6" released by "_delete_snapshot" :: held 1.701s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.947s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.824s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-840024952',display_name='tempest-VolumesGetTest-Volume-1842008232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aac64e2-255f-429c-846d-22dbfebf63fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b6070f8cf24924adbfd9857cda7e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:23Z,use_quota=True,user_id='d42d2fa4c87f46db9e6ba923994078cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Creating volume 2aac64e2-255f-429c-846d-22dbfebf63fa {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:28:36 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2aac64e2-255f-429c-846d-22dbfebf63fa 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3563576f-d311-49d7-aa77-76e447f8ed41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0', 'volume_size': 2, 'source_volid': 'dc46e3ac-86c4-406a-a5b4-778e4066dad6', 'source_volstatus': 'available'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:36 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2aac64e2-255f-429c-846d-22dbfebf63fa 1073741824 Sep 17 07:28:36 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8530ca8f-2a13-49be-8a9e-793751318afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:36 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Volume volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0 (94e0dd75-634b-4d83-997e-dad76e5a8dd0): created successfully Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8530ca8f-2a13-49be-8a9e-793751318afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Flow 'volume_create_manager' (66eadccb-f932-408e-8006-53a498a57cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:36 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-03451ad1-0619-4f16-a647-0250966d7970 tempest-VolumesCloneTest-1972597541 None] Created volume successfully. Sep 17 07:28:36 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2aac64e2-255f-429c-846d-22dbfebf63fa 1073741824" returned: 0 in 0.544s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2aac64e2-255f-429c-846d-22dbfebf63fa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:36 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2aac64e2-255f-429c-846d-22dbfebf63fa Sep 17 07:28:36 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:36 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2aac64e2-255f-429c-846d-22dbfebf63fa" returned: 0 in 0.254s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060dc63d-3934-48b9-9d13-775249e3d0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aac64e2-255f-429c-846d-22dbfebf63fa', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f498e572-4744-4399-8868-bd6462321722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:36 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Volume volume-2aac64e2-255f-429c-846d-22dbfebf63fa (2aac64e2-255f-429c-846d-22dbfebf63fa): created successfully Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f498e572-4744-4399-8868-bd6462321722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Flow 'volume_create_manager' (0b01b6c7-0b78-4c5e-8ffe-5f682722f906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:36 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-7e0d064c-2acb-4b16-99e9-14ad9f27ad49 tempest-VolumesGetTest-353056408 None] Created volume successfully. Sep 17 07:28:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-2aac64e2-255f-429c-846d-22dbfebf63fa-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Acquiring lock "cinder-94e0dd75-634b-4d83-997e-dad76e5a8dd0-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Lock "cinder-2aac64e2-255f-429c-846d-22dbfebf63fa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Lock "cinder-94e0dd75-634b-4d83-997e-dad76e5a8dd0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-quobyte-2aac64e2-255f-429c-846d-22dbfebf63fa" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-2aac64e2-255f-429c-846d-22dbfebf63fa" acquired by "delete_volume" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Acquiring lock "cinder-quobyte-94e0dd75-634b-4d83-997e-dad76e5a8dd0" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:37 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9554e5fd-86c0-4652-aece-bc526702b3d4]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2aac64e2-255f-429c-846d-22dbfebf63fa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Lock "cinder-quobyte-94e0dd75-634b-4d83-997e-dad76e5a8dd0" acquired by "delete_volume" :: waited 0.030s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:37 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[54087219-b8c0-43ed-bbfa-4cc7167782da]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:37 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2aac64e2-255f-429c-846d-22dbfebf63fa Sep 17 07:28:37 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:37 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0 Sep 17 07:28:37 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:38 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2aac64e2-255f-429c-846d-22dbfebf63fa" returned: 0 in 0.413s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2aac64e2-255f-429c-846d-22dbfebf63fa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:38 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0" returned: 0 in 0.392s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:38 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2aac64e2-255f-429c-846d-22dbfebf63fa Sep 17 07:28:38 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:38 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0 Sep 17 07:28:38 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:38 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:38 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2aac64e2-255f-429c-846d-22dbfebf63fa" returned: 0 in 0.290s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94e0dd75-634b-4d83-997e-dad76e5a8dd0" returned: 0 in 0.278s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-2aac64e2-255f-429c-846d-22dbfebf63fa" released by "delete_volume" :: held 0.758s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Lock "cinder-quobyte-94e0dd75-634b-4d83-997e-dad76e5a8dd0" released by "delete_volume" :: held 0.724s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Created reservations ['14cb72df-1529-4c38-bf70-06f547632499', '4f82931e-42cf-4361-a423-94a816ebab79', '475d061a-13e0-4dc4-8004-3defa73c0e0b', '2a99ef82-6028-4513-be98-94eeb0cf52d3'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Created reservations ['2e91a95b-1bbf-46dd-a746-8b9a147e2192', '7263dc9f-3f37-4f02-89ff-444584730f66', '472aed16-15dd-4994-b14d-0295fe66f023', 'cbd98769-7fc3-4adb-8f03-80b40766de2b'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:38 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:38 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:38 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:38 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-17da8a44-ed42-4f1d-a2a5-494ee2f24197-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Lock "cinder-17da8a44-ed42-4f1d-a2a5-494ee2f24197-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:39 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.351s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-quobyte-17da8a44-ed42-4f1d-a2a5-494ee2f24197" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Acquiring lock "cinder-dc46e3ac-86c4-406a-a5b4-778e4066dad6-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:39 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Deleted volume successfully. Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-17da8a44-ed42-4f1d-a2a5-494ee2f24197" acquired by "delete_volume" :: waited 0.040s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Lock "cinder-dc46e3ac-86c4-406a-a5b4-778e4066dad6-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4023b086-6d9e-4ac6-8e14-ac5a070e80ca tempest-VolumesGetTest-353056408 None] Lock "cinder-2aac64e2-255f-429c-846d-22dbfebf63fa-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d764ab1-40fd-4381-9777-1f03c977e400]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:39 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.441s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:39 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Deleted volume successfully. Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Acquiring lock "cinder-quobyte-dc46e3ac-86c4-406a-a5b4-778e4066dad6" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Lock "cinder-quobyte-dc46e3ac-86c4-406a-a5b4-778e4066dad6" acquired by "delete_volume" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3591183e-2d68-46a6-8d82-5e722749e961 tempest-VolumesCloneTest-1972597541 None] Lock "cinder-94e0dd75-634b-4d83-997e-dad76e5a8dd0-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb55691-68f2-4191-ae00-c605c84fa66c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:39 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197 Sep 17 07:28:39 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:39 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 Sep 17 07:28:39 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:39 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197" returned: 0 in 0.440s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:39 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197 Sep 17 07:28:39 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:39 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6" returned: 0 in 0.388s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:39 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6 Sep 17 07:28:39 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:39 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-17da8a44-ed42-4f1d-a2a5-494ee2f24197" returned: 0 in 0.262s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-17da8a44-ed42-4f1d-a2a5-494ee2f24197" released by "delete_volume" :: held 0.786s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:39 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc46e3ac-86c4-406a-a5b4-778e4066dad6" returned: 0 in 0.260s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Lock "cinder-quobyte-dc46e3ac-86c4-406a-a5b4-778e4066dad6" released by "delete_volume" :: held 0.720s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:39 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Created reservations ['38f4b395-c667-42ea-8f59-f97d3a8c2110', 'dfe48c36-1243-4c6d-9c81-f435fd0b561d', 'f7b1d847-5b86-45e4-8c0e-2ce4f5074a98', '758f867b-0410-40ce-aca6-7332aa90b322'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Created reservations ['1d3fa1e9-416d-4753-b017-66265f6d845d', 'c7fe7b02-c6fd-4003-9a8a-f87aeb6c665a', '8d34795c-e74d-4e10-a9a2-eb26630839a1', 'cb5b1663-a680-427f-854d-78847c80a4e2'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:40 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:40 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:40 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:40 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:40 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.317s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:40 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Deleted volume successfully. Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-32e05056-0b3b-4b10-9225-d5679ca5bd97 tempest-VolumesGetTest-353056408 None] Lock "cinder-17da8a44-ed42-4f1d-a2a5-494ee2f24197-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:40 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.370s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:40 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Deleted volume successfully. Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6fea7ac0-3615-4eaa-8dc5-cd154fe022ab tempest-VolumesCloneTest-1972597541 None] Lock "cinder-dc46e3ac-86c4-406a-a5b4-778e4066dad6-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Flow 'volume_create_manager' (1f1efb88-c2c4-420f-badc-4ed64b2fae33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f783f542-bf6f-4ea8-aba4-5ff740714162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f783f542-bf6f-4ea8-aba4-5ff740714162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-335536891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b6070f8cf24924adbfd9857cda7e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:41Z,use_quota=True,user_id='d42d2fa4c87f46db9e6ba923994078cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530258bf-1ee3-4d65-8831-7144152d076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530258bf-1ee3-4d65-8831-7144152d076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca62b4e-d7fa-4c7b-af43-e17211e407e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca62b4e-d7fa-4c7b-af43-e17211e407e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa', 'volume_name': 'volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41319f3-0240-44fd-ae7b-b01a0415500c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41319f3-0240-44fd-ae7b-b01a0415500c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26f3246-b83a-45fe-a9ed-3ec4afd3fc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:40 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Volume a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa', 'volume_size': 1} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-335536891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b6070f8cf24924adbfd9857cda7e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:41Z,use_quota=True,user_id='d42d2fa4c87f46db9e6ba923994078cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Creating volume a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:28:40 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:28:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:40 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa 1073741824 Sep 17 07:28:40 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:41 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa 1073741824" returned: 0 in 0.510s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:41 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa Sep 17 07:28:41 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:41 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa" returned: 0 in 0.349s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:28:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26f3246-b83a-45fe-a9ed-3ec4afd3fc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d9b6ca-8ce3-49f9-adc5-7621339863c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:41 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Volume volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa (a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa): created successfully Sep 17 07:28:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d9b6ca-8ce3-49f9-adc5-7621339863c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Flow 'volume_create_manager' (1f1efb88-c2c4-420f-badc-4ed64b2fae33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:41 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0ae5a043-49a6-46b0-9127-363fd8c58c84 tempest-VolumesGetTest-353056408 None] Created volume successfully. Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Flow 'volume_create_manager' (d43cb327-aadb-41d3-b455-ef62602d31f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9906b73a-dc97-4ad7-8770-edc94f570093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9906b73a-dc97-4ad7-8770-edc94f570093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-101526359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8dd0179-7832-4677-92a4-075cc69d9926,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0b6070f8cf24924adbfd9857cda7e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:44Z,use_quota=True,user_id='d42d2fa4c87f46db9e6ba923994078cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b98f22c-725e-4812-84fb-8a019a7e3c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b98f22c-725e-4812-84fb-8a019a7e3c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafc7c73-2acf-4a55-95c3-0785d43d148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafc7c73-2acf-4a55-95c3-0785d43d148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd8dd0179-7832-4677-92a4-075cc69d9926', 'volume_name': 'volume-d8dd0179-7832-4677-92a4-075cc69d9926', 'volume_size': 1, 'source_volid': 'a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa', 'source_volstatus': 'available'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59aa6fa-f1e8-4414-bba3-9e1bc6ab5cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59aa6fa-f1e8-4414-bba3-9e1bc6ab5cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0361b410-0872-4b0f-902c-ecd2bcf83f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:43 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Volume d8dd0179-7832-4677-92a4-075cc69d9926: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d8dd0179-7832-4677-92a4-075cc69d9926', 'volume_size': 1, 'source_volid': 'a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa', 'source_volstatus': 'available'} Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:43 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Cloning volume a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa to volume d8dd0179-7832-4677-92a4-075cc69d9926 Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Creating offline snapshot 7bef25bd-da3f-44ef-b75d-b9ab0b0f536f of volume a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3022b9-75fc-4f5c-b6d8-15561754681a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:43 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa Sep 17 07:28:43 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:44 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa" returned: 0 in 0.381s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:44 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f 1G Sep 17 07:28:44 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:44 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f 1G" returned: 0 in 0.461s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:44 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f Sep 17 07:28:44 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:44 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:28:45 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Flow 'volume_create_manager' (2daff540-8b5e-4445-b5fe-250872cd8f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f71dabf-a2b5-4445-8e1b-17ca1b74e328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f" returned: 0 in 0.413s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:45 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f is being set with open permissions: ugo+rw Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f71dabf-a2b5-4445-8e1b-17ca1b74e328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2078734443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad649579-c1a9-4862-8b87-46939ac733f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ed8175cded4e5984a90c7cbc749de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:45Z,use_quota=True,user_id='d0d23f57a23743d5a4a6d3c0769c932c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ad9c4c-8e39-4b61-ad81-520078b6ee42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:45 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f Sep 17 07:28:45 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ad9c4c-8e39-4b61-ad81-520078b6ee42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574a88c2-cab9-4b89-844c-4a4f068a57d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574a88c2-cab9-4b89-844c-4a4f068a57d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad649579-c1a9-4862-8b87-46939ac733f0', 'volume_name': 'volume-ad649579-c1a9-4862-8b87-46939ac733f0', 'volume_size': 2}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fdb003-f1df-40f2-9f4a-a390734c4316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fdb003-f1df-40f2-9f4a-a390734c4316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7356dae6-4662-4806-b001-3fcc61b2cc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:45 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Volume ad649579-c1a9-4862-8b87-46939ac733f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad649579-c1a9-4862-8b87-46939ac733f0', 'volume_size': 2} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:45 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f" returned: 0 in 0.264s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:45 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.info Sep 17 07:28:45 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:45 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.info" returned: 0 in 0.260s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:45 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.info is being set with open permissions: ugo+rw Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:45 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.info Sep 17 07:28:45 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:45 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.info" returned: 0 in 0.254s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-quobyte-d8dd0179-7832-4677-92a4-075cc69d9926" by "_copy_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-d8dd0179-7832-4677-92a4-075cc69d9926" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] snapshot: 7bef25bd-da3f-44ef-b75d-b9ab0b0f536f, volume: d8dd0179-7832-4677-92a4-075cc69d9926, {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e592439c-a992-4efe-93a7-d47a1b712b10]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:46 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f Sep 17 07:28:46 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Flow 'volume_create_manager' (6f511282-7a6e-4c0c-9720-ba7f27c49ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40944de-8d9b-4614-b2da-a85cb0636661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40944de-8d9b-4614-b2da-a85cb0636661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1553803708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8381177a-8a6c-4af1-8880-891463922f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba48e64f620e4c0693924a14f57095bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:46Z,use_quota=True,user_id='fb64c637bc1d46f7b9c442133bc5a2d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:46 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee23dd1e-05ce-4268-bd1c-87f37179a2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee23dd1e-05ce-4268-bd1c-87f37179a2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26b88bb-d634-4709-b2a3-a8fbe3c2d064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.image.glance [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Creating Keystone auth plugin from conf {{(pid=86029) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f" returned: 0 in 0.408s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4aea25f-2e4c-4f48-ba57-2a4a7e9a3f84]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:46 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa Sep 17 07:28:46 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26b88bb-d634-4709-b2a3-a8fbe3c2d064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8381177a-8a6c-4af1-8880-891463922f68', 'volume_name': 'volume-8381177a-8a6c-4af1-8880-891463922f68', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f7e3e41-8da3-4322-96df-7bd0fb12b893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f7e3e41-8da3-4322-96df-7bd0fb12b893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98323e56-42a5-4fa8-8897-cf2703790541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:46 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Volume 8381177a-8a6c-4af1-8880-891463922f68: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8381177a-8a6c-4af1-8880-891463922f68', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Trying to clone 8381177a-8a6c-4af1-8880-891463922f68 from image d174ccf1-c953-4210-b592-ccde541c6f06 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]). {{(pid=86029) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 07:28:46 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa" returned: 0 in 0.422s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] will copy from snapshot at /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Creating direct copy from snapshot {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.utils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Path /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926 not found in is_blk_device check {{(pid=86029) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:46 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926 Sep 17 07:28:46 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_c7ikwb6wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 07:28:46 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Image download 20.69 MB at 20.69 MB/s Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d70a9c-c178-4f20-8f09-f29ff82eccab]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_c7ikwb6wdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:47 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_c7ikwb6wdevstack@QuobyteHD Sep 17 07:28:47 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:47 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_c7ikwb6wdevstack@QuobyteHD" returned: 0 in 0.537s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:47 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Temporary image d174ccf1-c953-4210-b592-ccde541c6f06 is fetched for user fb64c637bc1d46f7b9c442133bc5a2d7. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 07:28:47 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b1561d-7198-452c-a2d3-87c3d17229ba]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_c7ikwb6wdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:47 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_c7ikwb6wdevstack@QuobyteHD Sep 17 07:28:47 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:48 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_c7ikwb6wdevstack@QuobyteHD" returned: 0 in 0.603s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:53 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926" returned: 0 in 6.470s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:28:53 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Converted 1024.00 MB image at 158.26 MB/s Sep 17 07:28:53 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926 is being set with open permissions: ugo+rw Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:53 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926 Sep 17 07:28:53 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:53 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926" returned: 0 in 0.253s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-d8dd0179-7832-4677-92a4-075cc69d9926" released by "_copy_volume_from_snapshot" :: held 7.652s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=138,cinder:UPDATE=188,cinder:INSERT=51,cinder:DELETE=14 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-quobyte-7bef25bd-da3f-44ef-b75d-b9ab0b0f536f" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-7bef25bd-da3f-44ef-b75d-b9ab0b0f536f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Deleting offline snapshot 7bef25bd-da3f-44ef-b75d-b9ab0b0f536f of volume a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] snapshot_file for this snap is: volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7340183-75f7-42ca-acc0-2e7ea108a968]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:53 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f Sep 17 07:28:53 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:53 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f" returned: 0 in 0.363s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[925ccd79-3c87-4515-b7df-ccdfe982e2f2]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:54 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa Sep 17 07:28:54 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:54 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa" returned: 0 in 0.553s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:54 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f Sep 17 07:28:54 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:54 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f" returned: 0 in 0.325s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:54 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f Sep 17 07:28:54 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:55 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa.7bef25bd-da3f-44ef-b75d-b9ab0b0f536f" returned: 0 in 0.243s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-7bef25bd-da3f-44ef-b75d-b9ab0b0f536f" released by "_delete_snapshot" :: held 1.573s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=127,cinder:INSERT=41,cinder:UPDATE=178,cinder:DELETE=16 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.450s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.078s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2078734443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad649579-c1a9-4862-8b87-46939ac733f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ed8175cded4e5984a90c7cbc749de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:45Z,use_quota=True,user_id='d0d23f57a23743d5a4a6d3c0769c932c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Creating volume ad649579-c1a9-4862-8b87-46939ac733f0 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:28:55 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ad649579-c1a9-4862-8b87-46939ac733f0 2147483648 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0361b410-0872-4b0f-902c-ecd2bcf83f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8dd0179-7832-4677-92a4-075cc69d9926', 'volume_size': 1, 'source_volid': 'a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa', 'source_volstatus': 'available'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:55 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ad649579-c1a9-4862-8b87-46939ac733f0 2147483648 Sep 17 07:28:55 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69fb5e09-e39a-4ef5-91ab-f56f8a7c8321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:55 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Volume volume-d8dd0179-7832-4677-92a4-075cc69d9926 (d8dd0179-7832-4677-92a4-075cc69d9926): created successfully Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69fb5e09-e39a-4ef5-91ab-f56f8a7c8321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Flow 'volume_create_manager' (d43cb327-aadb-41d3-b455-ef62602d31f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:55 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-17a61b65-aa71-4546-b751-6bca11f079d6 tempest-VolumesGetTest-353056408 None] Created volume successfully. Sep 17 07:28:55 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ad649579-c1a9-4862-8b87-46939ac733f0 2147483648" returned: 0 in 0.500s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ad649579-c1a9-4862-8b87-46939ac733f0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:55 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ad649579-c1a9-4862-8b87-46939ac733f0 Sep 17 07:28:55 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:55 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ad649579-c1a9-4862-8b87-46939ac733f0" returned: 0 in 0.247s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.731s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1553803708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8381177a-8a6c-4af1-8880-891463922f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba48e64f620e4c0693924a14f57095bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:46Z,use_quota=True,user_id='fb64c637bc1d46f7b9c442133bc5a2d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Creating volume 8381177a-8a6c-4af1-8880-891463922f68 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:28:55 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:28:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7356dae6-4662-4806-b001-3fcc61b2cc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad649579-c1a9-4862-8b87-46939ac733f0', 'volume_size': 2}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:56 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 1073741824 Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d27c2bd-9fb0-4297-9a80-8473ba6be1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:56 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:56 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Volume volume-ad649579-c1a9-4862-8b87-46939ac733f0 (ad649579-c1a9-4862-8b87-46939ac733f0): created successfully Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d27c2bd-9fb0-4297-9a80-8473ba6be1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Flow 'volume_create_manager' (2daff540-8b5e-4445-b5fe-250872cd8f23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:56 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-85945c8c-6a52-46aa-a44a-6f7631c8fe68 tempest-VolumesCloneNegativeTest-1871199091 None] Created volume successfully. Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Flow 'volume_create_manager' (b36dbe8a-1829-407f-a3a9-e222a9b3dca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c89e73c-7404-4523-a390-1d0e2cff0ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c89e73c-7404-4523-a390-1d0e2cff0ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-467922866',display_name='tempest-VolumesGetTest-Volume-2093768736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84af88de-0d34-4b8a-9cf1-e384e78e4572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b6070f8cf24924adbfd9857cda7e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:56Z,use_quota=True,user_id='d42d2fa4c87f46db9e6ba923994078cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07202dde-82ce-4be8-a95d-dcad682025b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07202dde-82ce-4be8-a95d-dcad682025b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae36eb22-7b52-430a-8f04-92392c9df188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae36eb22-7b52-430a-8f04-92392c9df188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84af88de-0d34-4b8a-9cf1-e384e78e4572', 'volume_name': 'volume-84af88de-0d34-4b8a-9cf1-e384e78e4572', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb2fbfd-d044-4cee-9bf8-6442e7be5dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb2fbfd-d044-4cee-9bf8-6442e7be5dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd85fdf-4b4f-492c-a847-8af4fefb9298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:56 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Volume 84af88de-0d34-4b8a-9cf1-e384e78e4572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84af88de-0d34-4b8a-9cf1-e384e78e4572', 'volume_size': 1} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:56 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 1073741824" returned: 0 in 0.470s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:56 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 Sep 17 07:28:56 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:56 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68" returned: 0 in 0.251s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:28:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-467922866',display_name='tempest-VolumesGetTest-Volume-2093768736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84af88de-0d34-4b8a-9cf1-e384e78e4572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b6070f8cf24924adbfd9857cda7e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:28:56Z,use_quota=True,user_id='d42d2fa4c87f46db9e6ba923994078cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Creating volume 84af88de-0d34-4b8a-9cf1-e384e78e4572 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:28:56 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-84af88de-0d34-4b8a-9cf1-e384e78e4572 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:56 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-84af88de-0d34-4b8a-9cf1-e384e78e4572 1073741824 Sep 17 07:28:56 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Attempting download of d174ccf1-c953-4210-b592-ccde541c6f06 ((None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}])) to volume 8381177a-8a6c-4af1-8880-891463922f68. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef022ca-492f-41bd-8baa-af2badd2e1f4]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_w8cbd016 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Acquiring lock "cinder-ad649579-c1a9-4862-8b87-46939ac733f0-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Lock "cinder-ad649579-c1a9-4862-8b87-46939ac733f0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:56 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_w8cbd016 Sep 17 07:28:56 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Acquiring lock "cinder-quobyte-ad649579-c1a9-4862-8b87-46939ac733f0" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Lock "cinder-quobyte-ad649579-c1a9-4862-8b87-46939ac733f0" acquired by "delete_volume" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb58b96-de33-4ff8-b3da-b3d2ea4e89ee]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ad649579-c1a9-4862-8b87-46939ac733f0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:57 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ad649579-c1a9-4862-8b87-46939ac733f0 Sep 17 07:28:57 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:57 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_w8cbd016" returned: 0 in 0.376s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_w8cbd016 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:57 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-84af88de-0d34-4b8a-9cf1-e384e78e4572 1073741824" returned: 0 in 0.486s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-84af88de-0d34-4b8a-9cf1-e384e78e4572 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:57 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-84af88de-0d34-4b8a-9cf1-e384e78e4572 Sep 17 07:28:57 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:57 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_w8cbd016 Sep 17 07:28:57 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:57 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ad649579-c1a9-4862-8b87-46939ac733f0" returned: 0 in 0.422s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ad649579-c1a9-4862-8b87-46939ac733f0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:57 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ad649579-c1a9-4862-8b87-46939ac733f0 Sep 17 07:28:57 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:57 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_w8cbd016" returned: 1 in 0.343s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_w8cbd016' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a967c4-67d1-43da-8d26-b51b4581d65f]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_c7ikwb6wdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:57 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-84af88de-0d34-4b8a-9cf1-e384e78e4572" returned: 0 in 0.305s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd85fdf-4b4f-492c-a847-8af4fefb9298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84af88de-0d34-4b8a-9cf1-e384e78e4572', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab0d14b-bd58-44bc-88fc-e761a882fe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:28:57 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Volume volume-84af88de-0d34-4b8a-9cf1-e384e78e4572 (84af88de-0d34-4b8a-9cf1-e384e78e4572): created successfully Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab0d14b-bd58-44bc-88fc-e761a882fe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Flow 'volume_create_manager' (b36dbe8a-1829-407f-a3a9-e222a9b3dca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:28:57 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a9f7c378-f08d-4540-b40f-751d74a151c4 tempest-VolumesGetTest-353056408 None] Created volume successfully. Sep 17 07:28:57 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_c7ikwb6wdevstack@QuobyteHD Sep 17 07:28:57 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:57 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ad649579-c1a9-4862-8b87-46939ac733f0" returned: 0 in 0.256s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Lock "cinder-quobyte-ad649579-c1a9-4862-8b87-46939ac733f0" released by "delete_volume" :: held 0.726s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Created reservations ['ee2b9e40-07b5-426b-a639-3e1c7d29b078', '7860394f-33e1-40d1-beb4-969d00e2c1a9', '2e105274-2be3-4c08-838e-827517e63f52', '8040a41f-79ff-4052-86d8-379739caf671'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:57 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:57 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:57 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_c7ikwb6wdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] d174ccf1-c953-4210-b592-ccde541c6f06 was qcow2, converting to qcow2 {{(pid=86029) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 07:28:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_c7ikwb6wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:57 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_c7ikwb6wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 Sep 17 07:28:57 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:58 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.250s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:58 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:28:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Deleted volume successfully. Sep 17 07:28:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cb688a68-9796-4545-9161-40d0ccce5a61 tempest-VolumesCloneNegativeTest-1871199091 None] Lock "cinder-ad649579-c1a9-4862-8b87-46939ac733f0-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-84af88de-0d34-4b8a-9cf1-e384e78e4572-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Lock "cinder-84af88de-0d34-4b8a-9cf1-e384e78e4572-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-quobyte-84af88de-0d34-4b8a-9cf1-e384e78e4572" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-84af88de-0d34-4b8a-9cf1-e384e78e4572" acquired by "delete_volume" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:58 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05c41c4-a016-41bf-b282-9b3c6d9a1797]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:28:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-84af88de-0d34-4b8a-9cf1-e384e78e4572 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:58 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-84af88de-0d34-4b8a-9cf1-e384e78e4572 Sep 17 07:28:58 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:59 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-84af88de-0d34-4b8a-9cf1-e384e78e4572" returned: 0 in 0.461s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-84af88de-0d34-4b8a-9cf1-e384e78e4572 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:59 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-84af88de-0d34-4b8a-9cf1-e384e78e4572 Sep 17 07:28:59 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:59 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-84af88de-0d34-4b8a-9cf1-e384e78e4572" returned: 0 in 0.306s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-84af88de-0d34-4b8a-9cf1-e384e78e4572" released by "delete_volume" :: held 0.815s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Created reservations ['5540c329-5849-4c3f-ae06-f009e70580ed', '435e3545-5167-4ce5-9b25-80a7c86f550b', '7340ea89-95ec-4910-8b0b-6e08ba206736', '3259172a-d4dd-4214-837e-b02aa041cfb6'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:28:59 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:28:59 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-d8dd0179-7832-4677-92a4-075cc69d9926-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Lock "cinder-d8dd0179-7832-4677-92a4-075cc69d9926-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-quobyte-d8dd0179-7832-4677-92a4-075cc69d9926" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:28:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-d8dd0179-7832-4677-92a4-075cc69d9926" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cee51c-e1ba-410b-92d6-354371cabddf]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:00 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.395s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Deleted volume successfully. Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7048b5a6-fe1d-48be-a428-814a6d24bf74 tempest-VolumesGetTest-353056408 None] Lock "cinder-84af88de-0d34-4b8a-9cf1-e384e78e4572-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:00 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926 Sep 17 07:29:00 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:00 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_c7ikwb6wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68" returned: 0 in 2.319s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_c7ikwb6wdevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:29:00 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Converted 112.00 MB image at 48.28 MB/s Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:00 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 1G Sep 17 07:29:00 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:00 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926" returned: 0 in 0.468s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:00 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926 Sep 17 07:29:00 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:00 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 1G" returned: 0 in 0.407s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Downloaded image d174ccf1-c953-4210-b592-ccde541c6f06 ((None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}])) to volume 8381177a-8a6c-4af1-8880-891463922f68 successfully. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Temporary image d174ccf1-c953-4210-b592-ccde541c6f06 for user fb64c637bc1d46f7b9c442133bc5a2d7 is deleted. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Marking volume 8381177a-8a6c-4af1-8880-891463922f68 as bootable. {{(pid=86029) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Copying metadata from image d174ccf1-c953-4210-b592-ccde541c6f06 to 8381177a-8a6c-4af1-8880-891463922f68. {{(pid=86029) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Creating volume glance metadata for volume 8381177a-8a6c-4af1-8880-891463922f68 backed by image d174ccf1-c953-4210-b592-ccde541c6f06 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86029) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98323e56-42a5-4fa8-8897-cf2703790541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8381177a-8a6c-4af1-8880-891463922f68', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806390bf-0acc-4ea3-b429-2cd1fc69f727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:00 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Volume volume-8381177a-8a6c-4af1-8880-891463922f68 (8381177a-8a6c-4af1-8880-891463922f68): created successfully Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806390bf-0acc-4ea3-b429-2cd1fc69f727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Flow 'volume_create_manager' (6f511282-7a6e-4c0c-9720-ba7f27c49ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:00 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-66ce1012-b950-42b7-9d87-26d45fac8793 tempest-VolumesImageMetadata-256063220 None] Created volume successfully. Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d8dd0179-7832-4677-92a4-075cc69d9926" returned: 0 in 0.317s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-d8dd0179-7832-4677-92a4-075cc69d9926" released by "delete_volume" :: held 0.837s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Created reservations ['4a8c7e5b-a573-4335-b15e-4aa6cf664121', '60a5814a-d7f8-4b5f-977a-ccdf1eb8109d', '955140a3-bbec-4847-9ce7-80670cd7bb2a', '530e1344-f132-4f72-8331-6625ce8d931b'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:00 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:29:00 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Lock "cinder-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-quobyte-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:01 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.281s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:01 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Deleted volume successfully. Sep 17 07:29:01 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7de02c1-507c-4d94-9ec9-85a94a07728a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1ac2a600-5e04-446f-94d0-557bcf19d09f tempest-VolumesGetTest-353056408 None] Lock "cinder-d8dd0179-7832-4677-92a4-075cc69d9926-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:01 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa Sep 17 07:29:01 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:01 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa" returned: 0 in 0.382s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:01 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa Sep 17 07:29:01 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:01 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa" returned: 0 in 0.261s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa" released by "delete_volume" :: held 0.715s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:01 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Created reservations ['daf56bc4-bb99-47a9-8ee9-60b6ee782370', '197dff66-c8eb-4761-961c-cd8e73cca54f', 'c616427c-e4cb-4049-9e7c-a3a863d018f2', '352292dd-d378-43b9-8ba9-0fe1369879a3'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:02 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:29:02 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:02 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.268s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:02 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Deleted volume successfully. Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-59364a09-997a-4a52-9a44-e356cd3333da tempest-VolumesGetTest-353056408 None] Lock "cinder-a573c9e2-9575-4c4c-9c3a-34ab2a29eaaa-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Acquiring lock "cinder-8381177a-8a6c-4af1-8880-891463922f68-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Lock "cinder-8381177a-8a6c-4af1-8880-891463922f68-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Acquiring lock "cinder-quobyte-8381177a-8a6c-4af1-8880-891463922f68" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Lock "cinder-quobyte-8381177a-8a6c-4af1-8880-891463922f68" acquired by "delete_volume" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b637ec-03bf-458e-b8d5-0fa6b790ef3a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Flow 'volume_create_manager' (d7346d9b-0def-42e7-96a8-31f52e5ac505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22404950-7b92-478c-a0d7-09caba447f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22404950-7b92-478c-a0d7-09caba447f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1088352677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7935665-68d9-47c3-9c0b-d0ecc61fd8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9e71fc541044eab86ed489561ad53e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:03Z,use_quota=True,user_id='9349ea94df324da79fd63125494d6e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e962e57-4f18-4d8f-8ba9-85c43638e213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e962e57-4f18-4d8f-8ba9-85c43638e213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7c022a-3667-4887-a333-419916579024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:02 devstack cinder-volume[86029]: DEBUG cinder.image.glance [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Creating Keystone auth plugin from conf {{(pid=86029) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 07:29:02 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 Sep 17 07:29:02 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Flow 'volume_create_manager' (3f84f2ef-b741-4108-9ea3-dbe9a488b645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba6310d-162d-4d33-8116-9f2d2be62ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7c022a-3667-4887-a333-419916579024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd7935665-68d9-47c3-9c0b-d0ecc61fd8d7', 'volume_name': 'volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ec40b4-165c-47dd-adf4-022201624e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:03 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ec40b4-165c-47dd-adf4-022201624e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b127da49-dbd1-4ae4-a399-87b71a31b1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:03 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Volume d7935665-68d9-47c3-9c0b-d0ecc61fd8d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Trying to clone d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 from image d174ccf1-c953-4210-b592-ccde541c6f06 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]). {{(pid=86029) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68" returned: 0 in 0.429s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba6310d-162d-4d33-8116-9f2d2be62ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1145568397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d5137d-2ab8-40cb-b127-ebc7ae4a4266,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0b6070f8cf24924adbfd9857cda7e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:03Z,use_quota=True,user_id='d42d2fa4c87f46db9e6ba923994078cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:03 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68 Sep 17 07:29:03 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2bdc218-8333-496f-92d2-91f39205ab55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2bdc218-8333-496f-92d2-91f39205ab55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb34898-65f2-4127-bc82-ffcce0805315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.image.glance [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Creating Keystone auth plugin from conf {{(pid=86029) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 07:29:03 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8381177a-8a6c-4af1-8880-891463922f68" returned: 0 in 0.291s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Lock "cinder-quobyte-8381177a-8a6c-4af1-8880-891463922f68" released by "delete_volume" :: held 0.801s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb34898-65f2-4127-bc82-ffcce0805315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e8d5137d-2ab8-40cb-b127-ebc7ae4a4266', 'volume_name': 'volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389581f3-bfea-4a13-8754-57890e651614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389581f3-bfea-4a13-8754-57890e651614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bf2cb0-8df3-48db-872b-95ede3c51144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:03 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Volume e8d5137d-2ab8-40cb-b127-ebc7ae4a4266: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Trying to clone e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 from image d174ccf1-c953-4210-b592-ccde541c6f06 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]). {{(pid=86029) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ikmcdxx_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 07:29:03 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Image download 20.69 MB at 20.69 MB/s Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Created reservations ['9b16d5ae-6bc4-44fa-ba8a-ec4a33110aea', 'f5a03d90-417c-4c04-90b4-9a04bc0f5fc0', 'd1413ff6-4398-4dd2-bfd8-ffc0df2be687', '0a4d1307-3bf9-447c-b02d-30036fec630d'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d17fe2-4ba4-43e2-b4ae-833ca04cac1d]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ikmcdxx_devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:03 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ikmcdxx_devstack@QuobyteHD Sep 17 07:29:03 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:03 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:29:03 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ttdjb5nkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 07:29:04 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Image download 20.69 MB at 20.69 MB/s Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62ac7cc-e64c-48ee-8461-12d4e8fccb01]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ttdjb5nkdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:04 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ikmcdxx_devstack@QuobyteHD" returned: 0 in 0.470s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Temporary image d174ccf1-c953-4210-b592-ccde541c6f06 is fetched for user 9349ea94df324da79fd63125494d6e9d. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[37da4fec-cc8c-4323-a499-638ad2702a57]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ikmcdxx_devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:04 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.393s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:04 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ttdjb5nkdevstack@QuobyteHD Sep 17 07:29:04 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:04 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Deleted volume successfully. Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1d8ae52a-87df-4e5d-90b1-bcfa84bc3836 tempest-VolumesImageMetadata-256063220 None] Lock "cinder-8381177a-8a6c-4af1-8880-891463922f68-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:04 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ikmcdxx_devstack@QuobyteHD Sep 17 07:29:04 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:04 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ttdjb5nkdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Temporary image d174ccf1-c953-4210-b592-ccde541c6f06 is fetched for user d42d2fa4c87f46db9e6ba923994078cf. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0760d9d4-dc06-4756-86f9-0f67c38bf915]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ttdjb5nkdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:04 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ikmcdxx_devstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1088352677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7935665-68d9-47c3-9c0b-d0ecc61fd8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9e71fc541044eab86ed489561ad53e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:03Z,use_quota=True,user_id='9349ea94df324da79fd63125494d6e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Creating volume d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:29:04 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:04 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 1073741824 Sep 17 07:29:04 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:04 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ttdjb5nkdevstack@QuobyteHD Sep 17 07:29:04 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:04 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:29:04 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:04 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ttdjb5nkdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:05 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 1073741824" returned: 0 in 0.503s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:05 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.335s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:05 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 Sep 17 07:29:05 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:05 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7" returned: 0 in 0.286s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.545s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1145568397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d5137d-2ab8-40cb-b127-ebc7ae4a4266,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0b6070f8cf24924adbfd9857cda7e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:03Z,use_quota=True,user_id='d42d2fa4c87f46db9e6ba923994078cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Creating volume e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:29:05 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:05 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 1073741824 Sep 17 07:29:05 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Attempting download of d174ccf1-c953-4210-b592-ccde541c6f06 ((None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}])) to volume d7935665-68d9-47c3-9c0b-d0ecc61fd8d7. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d825db74-e6de-4229-988c-79007a64df47]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_7xi0yqca {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:05 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_7xi0yqca Sep 17 07:29:05 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:05 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_7xi0yqca" returned: 0 in 0.361s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_7xi0yqca {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:05 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 1073741824" returned: 0 in 0.485s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:06 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 Sep 17 07:29:06 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:06 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_7xi0yqca Sep 17 07:29:06 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:06 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266" returned: 0 in 0.285s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:06 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_7xi0yqca" returned: 1 in 0.371s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_7xi0yqca' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4efa0e-7dba-4cf5-9614-caeaa78462dd]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ikmcdxx_devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Attempting download of d174ccf1-c953-4210-b592-ccde541c6f06 ((None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}])) to volume e8d5137d-2ab8-40cb-b127-ebc7ae4a4266. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b61b03-2233-4aea-bf92-d9491a114100]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_n4y0e41g {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:06 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ikmcdxx_devstack@QuobyteHD Sep 17 07:29:06 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:06 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_n4y0e41g Sep 17 07:29:06 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:06 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ikmcdxx_devstack@QuobyteHD" returned: 0 in 0.377s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] d174ccf1-c953-4210-b592-ccde541c6f06 was qcow2, converting to qcow2 {{(pid=86029) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ikmcdxx_devstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:06 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ikmcdxx_devstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 Sep 17 07:29:06 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:06 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_n4y0e41g" returned: 0 in 0.363s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_n4y0e41g {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:06 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_n4y0e41g Sep 17 07:29:06 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:07 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_n4y0e41g" returned: 1 in 0.344s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_n4y0e41g' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:29:07 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9af4bbf-a751-4cf8-8b57-5395ad99b3f3]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ttdjb5nkdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:07 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ttdjb5nkdevstack@QuobyteHD Sep 17 07:29:07 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:07 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ttdjb5nkdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:07 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] d174ccf1-c953-4210-b592-ccde541c6f06 was qcow2, converting to qcow2 {{(pid=86029) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 07:29:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ttdjb5nkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:07 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ttdjb5nkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 Sep 17 07:29:07 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Flow 'volume_create_manager' (1b9895bb-420d-4f1f-8cb3-a964f937ed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1899a9eb-3788-49e0-a53b-34184046cb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1899a9eb-3788-49e0-a53b-34184046cb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1666073299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495b9789-091b-4505-b62f-d0d20e913262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9c9a19f3b74965be4fa275180d03d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:08Z,use_quota=True,user_id='bc0167bd0aaa461d8b2ff653befc0f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd81c05c-1e6c-4f1a-a74a-9b9cc838806f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd81c05c-1e6c-4f1a-a74a-9b9cc838806f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef515001-0888-4579-8043-36cbb336101b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef515001-0888-4579-8043-36cbb336101b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '495b9789-091b-4505-b62f-d0d20e913262', 'volume_name': 'volume-495b9789-091b-4505-b62f-d0d20e913262', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e74b57-8771-45a5-81a1-6b683e7c46d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e74b57-8771-45a5-81a1-6b683e7c46d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0bddd6a-720a-4fed-aea3-20fd84e19543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:08 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Volume 495b9789-091b-4505-b62f-d0d20e913262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-495b9789-091b-4505-b62f-d0d20e913262', 'volume_size': 1} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1666073299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495b9789-091b-4505-b62f-d0d20e913262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9c9a19f3b74965be4fa275180d03d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:08Z,use_quota=True,user_id='bc0167bd0aaa461d8b2ff653befc0f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Creating volume 495b9789-091b-4505-b62f-d0d20e913262 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:29:08 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:08 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262 1073741824 Sep 17 07:29:08 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:08 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262 1073741824" returned: 0 in 0.586s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:08 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262 Sep 17 07:29:08 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:08 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ikmcdxx_devstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7" returned: 0 in 2.259s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ikmcdxx_devstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:29:08 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Converted 112.00 MB image at 49.52 MB/s Sep 17 07:29:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:09 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 1G Sep 17 07:29:09 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:09 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262" returned: 0 in 0.272s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0bddd6a-720a-4fed-aea3-20fd84e19543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-495b9789-091b-4505-b62f-d0d20e913262', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed361285-d2ad-4c9a-9b4c-4cc2f78c4de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:09 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Volume volume-495b9789-091b-4505-b62f-d0d20e913262 (495b9789-091b-4505-b62f-d0d20e913262): created successfully Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed361285-d2ad-4c9a-9b4c-4cc2f78c4de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Flow 'volume_create_manager' (1b9895bb-420d-4f1f-8cb3-a964f937ed94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:09 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4b789a15-36d9-4713-9da2-a966d02d7860 tempest-SnapshotMetadataTestJSON-49733491 None] Created volume successfully. Sep 17 07:29:09 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 1G" returned: 0 in 0.388s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Downloaded image d174ccf1-c953-4210-b592-ccde541c6f06 ((None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}])) to volume d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 successfully. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Temporary image d174ccf1-c953-4210-b592-ccde541c6f06 for user 9349ea94df324da79fd63125494d6e9d is deleted. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Marking volume d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 as bootable. {{(pid=86029) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Copying metadata from image d174ccf1-c953-4210-b592-ccde541c6f06 to d7935665-68d9-47c3-9c0b-d0ecc61fd8d7. {{(pid=86029) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Creating volume glance metadata for volume d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 backed by image d174ccf1-c953-4210-b592-ccde541c6f06 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86029) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b127da49-dbd1-4ae4-a399-87b71a31b1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d7fc96-ac78-41df-9109-c93f397de847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:09 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Volume volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 (d7935665-68d9-47c3-9c0b-d0ecc61fd8d7): created successfully Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d7fc96-ac78-41df-9109-c93f397de847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Flow 'volume_create_manager' (d7346d9b-0def-42e7-96a8-31f52e5ac505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:09 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-bdb2ea22-5a83-4f53-8571-ce17b1db5ad8 tempest-VolumesExtendTest-880810955 None] Created volume successfully. Sep 17 07:29:09 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ttdjb5nkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266" returned: 0 in 2.284s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_ttdjb5nkdevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:29:09 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Converted 112.00 MB image at 49.01 MB/s Sep 17 07:29:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:09 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 1G Sep 17 07:29:09 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:10 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 1G" returned: 0 in 0.325s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Downloaded image d174ccf1-c953-4210-b592-ccde541c6f06 ((None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}])) to volume e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 successfully. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Temporary image d174ccf1-c953-4210-b592-ccde541c6f06 for user d42d2fa4c87f46db9e6ba923994078cf is deleted. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Marking volume e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 as bootable. {{(pid=86029) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Copying metadata from image d174ccf1-c953-4210-b592-ccde541c6f06 to e8d5137d-2ab8-40cb-b127-ebc7ae4a4266. {{(pid=86029) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Creating volume glance metadata for volume e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 backed by image d174ccf1-c953-4210-b592-ccde541c6f06 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86029) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bf2cb0-8df3-48db-872b-95ede3c51144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24bbc71f-4285-44dc-9fce-99bc9b4f82ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] Creating offline snapshot 8523c526-2665-4596-8c48-172223ba31b5 of volume 495b9789-091b-4505-b62f-d0d20e913262 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:29:10 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Volume volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 (e8d5137d-2ab8-40cb-b127-ebc7ae4a4266): created successfully Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24bbc71f-4285-44dc-9fce-99bc9b4f82ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Flow 'volume_create_manager' (3f84f2ef-b741-4108-9ea3-dbe9a488b645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d49408-0013-4b32-a71a-47cb3eba7402]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:10 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b800f91c-2aa4-46b3-a388-fe03d59dbd90 tempest-VolumesGetTest-353056408 None] Created volume successfully. Sep 17 07:29:10 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262 Sep 17 07:29:10 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0b07006a-630b-4398-92a9-ff9148cdc1da tempest-VolumesExtendTest-880810955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:10 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262" returned: 0 in 0.392s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:10 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 1G Sep 17 07:29:10 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:11 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 1G" returned: 0 in 0.421s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-495b9789-091b-4505-b62f-d0d20e913262 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:11 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-495b9789-091b-4505-b62f-d0d20e913262 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 Sep 17 07:29:11 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Flow 'volume_create_manager' (5665ff92-c0ed-49be-a43c-994e77a2ac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cdb63a-7904-4d36-b7b6-2d2fc2276ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cdb63a-7904-4d36-b7b6-2d2fc2276ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1929111007',display_name='tempest-VolumesGetTest-Volume-950027740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720d4953-7c5d-4311-88aa-d534c8581099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b6070f8cf24924adbfd9857cda7e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:11Z,use_quota=True,user_id='d42d2fa4c87f46db9e6ba923994078cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6565d662-2b9b-44b9-a920-12c0931a7231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6565d662-2b9b-44b9-a920-12c0931a7231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd79c7ee-ba81-4276-a9ee-3aa302bbeb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd79c7ee-ba81-4276-a9ee-3aa302bbeb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '720d4953-7c5d-4311-88aa-d534c8581099', 'volume_name': 'volume-720d4953-7c5d-4311-88aa-d534c8581099', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ae3611-57fb-469f-8624-320ae30eed79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ae3611-57fb-469f-8624-320ae30eed79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc68debc-c2f6-47d3-b7a0-08c50acec876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:11 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Volume 720d4953-7c5d-4311-88aa-d534c8581099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-720d4953-7c5d-4311-88aa-d534c8581099', 'volume_size': 1} Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:11 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-495b9789-091b-4505-b62f-d0d20e913262 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5" returned: 0 in 0.310s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:11 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 is being set with open permissions: ugo+rw Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:11 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 Sep 17 07:29:11 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:11 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5" returned: 0 in 0.244s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:11 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.info Sep 17 07:29:11 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:11 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.info" returned: 0 in 0.244s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:11 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.info is being set with open permissions: ugo+rw Sep 17 07:29:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:11 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.info Sep 17 07:29:11 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:12 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.info" returned: 0 in 0.238s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.957s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0b07006a-630b-4398-92a9-ff9148cdc1da tempest-VolumesExtendTest-880810955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.720s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[65acadfb-5ff5-423d-bd8f-64b094096fa7]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0b07006a-630b-4398-92a9-ff9148cdc1da tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:12 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-9cfecc80-7ff0-442b-a5ca-f40f3b8dd54e tempest-SnapshotMetadataTestJSON-49733491 None] Create snapshot completed successfully Sep 17 07:29:12 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 Sep 17 07:29:12 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:12 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0b07006a-630b-4398-92a9-ff9148cdc1da tempest-VolumesExtendTest-880810955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7" returned: 0 in 0.405s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0b07006a-630b-4398-92a9-ff9148cdc1da tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 2G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0b07006a-630b-4398-92a9-ff9148cdc1da tempest-VolumesExtendTest-880810955 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 2G" returned: 0 in 0.105s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0b07006a-630b-4398-92a9-ff9148cdc1da tempest-VolumesExtendTest-880810955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.544s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.339s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1929111007',display_name='tempest-VolumesGetTest-Volume-950027740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720d4953-7c5d-4311-88aa-d534c8581099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b6070f8cf24924adbfd9857cda7e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:11Z,use_quota=True,user_id='d42d2fa4c87f46db9e6ba923994078cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Creating volume 720d4953-7c5d-4311-88aa-d534c8581099 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:29:12 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:29:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-720d4953-7c5d-4311-88aa-d534c8581099 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:12 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-720d4953-7c5d-4311-88aa-d534c8581099 1073741824 Sep 17 07:29:12 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:12 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0b07006a-630b-4398-92a9-ff9148cdc1da tempest-VolumesExtendTest-880810955 None] Extend volume completed successfully. Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Acquiring lock "cinder-8523c526-2665-4596-8c48-172223ba31b5-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Lock "cinder-8523c526-2665-4596-8c48-172223ba31b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Acquiring lock "cinder-quobyte-495b9789-091b-4505-b62f-d0d20e913262" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Lock "cinder-quobyte-495b9789-091b-4505-b62f-d0d20e913262" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Acquiring lock "cinder-quobyte-8523c526-2665-4596-8c48-172223ba31b5" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Lock "cinder-quobyte-8523c526-2665-4596-8c48-172223ba31b5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Deleting offline snapshot 8523c526-2665-4596-8c48-172223ba31b5 of volume 495b9789-091b-4505-b62f-d0d20e913262 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] snapshot_file for this snap is: volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db7787c-3dd3-4ad2-89ca-3c7ebe6d66af]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:13 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-720d4953-7c5d-4311-88aa-d534c8581099 1073741824" returned: 0 in 0.470s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:13 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 Sep 17 07:29:13 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-720d4953-7c5d-4311-88aa-d534c8581099 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:13 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-720d4953-7c5d-4311-88aa-d534c8581099 Sep 17 07:29:13 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:13 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-720d4953-7c5d-4311-88aa-d534c8581099" returned: 0 in 0.269s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:13 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc68debc-c2f6-47d3-b7a0-08c50acec876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-720d4953-7c5d-4311-88aa-d534c8581099', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d59b26d-2504-4615-8997-e5f3acd6516a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5" returned: 0 in 0.429s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-495b9789-091b-4505-b62f-d0d20e913262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:29:13 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Volume volume-720d4953-7c5d-4311-88aa-d534c8581099 (720d4953-7c5d-4311-88aa-d534c8581099): created successfully Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d59b26d-2504-4615-8997-e5f3acd6516a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Flow 'volume_create_manager' (5665ff92-c0ed-49be-a43c-994e77a2ac2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c770a8e9-73c8-46a5-a830-8d46258033a5]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:13 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-f930fe7d-b0ac-4c43-9903-3afec4cba2e0 tempest-VolumesGetTest-353056408 None] Created volume successfully. Sep 17 07:29:13 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262 Sep 17 07:29:13 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:14 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262" returned: 0 in 0.375s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Acquiring lock "cinder-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:14 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 Sep 17 07:29:14 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Lock "cinder-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Acquiring lock "cinder-quobyte-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Lock "cinder-quobyte-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7" acquired by "delete_volume" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa75a8e5-22ac-4dbc-b2fb-22523abefe1a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:14 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 Sep 17 07:29:14 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:14 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5" returned: 0 in 0.372s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:14 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5 Sep 17 07:29:14 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:14 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7" returned: 0 in 0.402s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:14 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7 Sep 17 07:29:14 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-720d4953-7c5d-4311-88aa-d534c8581099-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Lock "cinder-720d4953-7c5d-4311-88aa-d534c8581099-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:14 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262.8523c526-2665-4596-8c48-172223ba31b5" returned: 0 in 0.301s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-quobyte-720d4953-7c5d-4311-88aa-d534c8581099" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Lock "cinder-quobyte-8523c526-2665-4596-8c48-172223ba31b5" released by "_delete_snapshot" :: held 1.602s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-720d4953-7c5d-4311-88aa-d534c8581099" acquired by "delete_volume" :: waited 0.043s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Lock "cinder-quobyte-495b9789-091b-4505-b62f-d0d20e913262" released by "delete_snapshot" :: held 1.638s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a1217a-2d95-44a1-a1ce-8a10ed7d02b3]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-720d4953-7c5d-4311-88aa-d534c8581099 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Created reservations ['995383da-2828-4460-aca1-066440c9e57b', 'd6e803e9-c098-4c17-9d0e-54a187d74585', '4e368ad3-8ca3-45be-bdf8-e1e957950fa2', 'ed859742-55ac-46a1-9ff4-68c7df21e0bf'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:14 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7" returned: 0 in 0.299s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Lock "cinder-quobyte-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7" released by "delete_volume" :: held 0.754s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:14 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-720d4953-7c5d-4311-88aa-d534c8581099 Sep 17 07:29:14 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:14 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Delete snapshot completed successfully. Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e45be533-38d4-4929-944e-f0685351d31f tempest-SnapshotMetadataTestJSON-49733491 None] Lock "cinder-8523c526-2665-4596-8c48-172223ba31b5-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Created reservations ['f37fcfad-2a43-4e76-9f12-449f298b42da', '8421fc58-eaa3-4623-9abb-cb32e5527823', '000d38ec-6ec2-43b2-9f0f-0a0f72d38ea5', '9738a87d-845b-4501-bab2-a7f6057c777d'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:15 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:29:15 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:15 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-720d4953-7c5d-4311-88aa-d534c8581099" returned: 0 in 0.400s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-720d4953-7c5d-4311-88aa-d534c8581099 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:15 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-720d4953-7c5d-4311-88aa-d534c8581099 Sep 17 07:29:15 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:15 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.275s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:15 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Deleted volume successfully. Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Acquiring lock "cinder-495b9789-091b-4505-b62f-d0d20e913262-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6848251d-dcf9-4f8d-9dc5-b3a02e9653de tempest-VolumesExtendTest-880810955 None] Lock "cinder-d7935665-68d9-47c3-9c0b-d0ecc61fd8d7-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Lock "cinder-495b9789-091b-4505-b62f-d0d20e913262-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Acquiring lock "cinder-quobyte-495b9789-091b-4505-b62f-d0d20e913262" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Lock "cinder-quobyte-495b9789-091b-4505-b62f-d0d20e913262" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7679a3-3a44-4e20-9006-f40479eb1f8d]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:15 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-720d4953-7c5d-4311-88aa-d534c8581099" returned: 0 in 0.319s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-720d4953-7c5d-4311-88aa-d534c8581099" released by "delete_volume" :: held 0.773s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:15 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262 Sep 17 07:29:15 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Created reservations ['7e7cf4c7-bd74-4467-8a49-da7f741c4451', 'e09c6e54-154c-447a-941c-d4273a570221', 'c0c419e5-e8e5-4bda-8f04-e721628a6fac', '21bd6ddb-2687-41db-a477-fc08197fb58d'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:15 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:29:15 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Flow 'volume_create_manager' (bd3db535-75b3-4968-a711-a61cc6eed637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1662390b-75f4-421c-ae71-1341ecb38471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1662390b-75f4-421c-ae71-1341ecb38471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1875648152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3786e991-da68-4b4a-b35c-b22d99406609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9e71fc541044eab86ed489561ad53e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:16Z,use_quota=True,user_id='9349ea94df324da79fd63125494d6e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa465ce-95a8-436f-bf60-986ee2a240d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa465ce-95a8-436f-bf60-986ee2a240d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43df0c1-f0f6-42a5-a652-158aedd0d8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43df0c1-f0f6-42a5-a652-158aedd0d8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3786e991-da68-4b4a-b35c-b22d99406609', 'volume_name': 'volume-3786e991-da68-4b4a-b35c-b22d99406609', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747a1833-3c04-4a0e-9f93-e0d0ee03d1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747a1833-3c04-4a0e-9f93-e0d0ee03d1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4716c325-ddd8-45df-9535-7f09ea0ff5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:15 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Volume 3786e991-da68-4b4a-b35c-b22d99406609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3786e991-da68-4b4a-b35c-b22d99406609', 'volume_size': 1} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1875648152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3786e991-da68-4b4a-b35c-b22d99406609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9e71fc541044eab86ed489561ad53e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:16Z,use_quota=True,user_id='9349ea94df324da79fd63125494d6e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Creating volume 3786e991-da68-4b4a-b35c-b22d99406609 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:29:15 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:15 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262" returned: 0 in 0.433s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:15 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 1073741824 Sep 17 07:29:15 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:15 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262 Sep 17 07:29:15 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Lock "cinder-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:15 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.321s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:16 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Deleted volume successfully. Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Acquiring lock "cinder-quobyte-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-cf564743-0350-4842-9da5-83cdc84bbe04 tempest-VolumesGetTest-353056408 None] Lock "cinder-720d4953-7c5d-4311-88aa-d534c8581099-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3330404d-dd69-43ab-b81a-5284c1e18233]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:16 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 Sep 17 07:29:16 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:16 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-495b9789-091b-4505-b62f-d0d20e913262" returned: 0 in 0.323s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Lock "cinder-quobyte-495b9789-091b-4505-b62f-d0d20e913262" released by "delete_volume" :: held 0.849s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Created reservations ['ca5814ab-df1c-4b89-97b2-079590d531ea', '1bba277f-9ef5-4d9b-8765-7ffff4389f36', '21782bb4-b092-4176-ad46-aa8954f5fac5', '5df2535f-85b1-45d5-b514-ae30b05fe208'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:16 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 1073741824" returned: 0 in 0.532s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:16 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:29:16 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:16 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 Sep 17 07:29:16 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:16 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266" returned: 0 in 0.464s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:16 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266 Sep 17 07:29:16 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:16 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.301s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:16 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Deleted volume successfully. Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-92541f81-a9e5-4635-b2ff-c8b39c3e41e1 tempest-SnapshotMetadataTestJSON-49733491 None] Lock "cinder-495b9789-091b-4505-b62f-d0d20e913262-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:16 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609" returned: 0 in 0.313s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4716c325-ddd8-45df-9535-7f09ea0ff5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3786e991-da68-4b4a-b35c-b22d99406609', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268fec74-2065-4b9f-9b5e-e52e0ebbaf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:16 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Volume volume-3786e991-da68-4b4a-b35c-b22d99406609 (3786e991-da68-4b4a-b35c-b22d99406609): created successfully Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268fec74-2065-4b9f-9b5e-e52e0ebbaf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Flow 'volume_create_manager' (bd3db535-75b3-4968-a711-a61cc6eed637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:16 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-09c9dbb5-9046-46dc-b6aa-722b7b810d28 tempest-VolumesExtendTest-880810955 None] Created volume successfully. Sep 17 07:29:16 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266" returned: 0 in 0.319s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Lock "cinder-quobyte-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266" released by "delete_volume" :: held 0.823s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Created reservations ['e9435b78-02f3-4360-83a4-02449544344d', '33c57679-03d3-4408-bc72-363c473b2179', '6093a4ca-3550-4f9d-b748-7739a9c4884f', '847d2fa6-eba9-4c6d-9d16-43346b26ffb0'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:17 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:29:17 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:17 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.273s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:17 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:17 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Deleted volume successfully. Sep 17 07:29:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-37cfc485-a2b4-4d60-9bf8-645e99dd1517 tempest-VolumesGetTest-353056408 None] Lock "cinder-e8d5137d-2ab8-40cb-b127-ebc7ae4a4266-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] Creating offline snapshot ed425f5c-1d97-4bb1-a637-686aa16c090d of volume 3786e991-da68-4b4a-b35c-b22d99406609 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:29:18 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8dfed1-80a3-4031-8dce-a95e0a5f5a42]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:18 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 Sep 17 07:29:18 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:18 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609" returned: 0 in 0.441s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:18 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d 1G Sep 17 07:29:18 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:19 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d 1G" returned: 0 in 0.489s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3786e991-da68-4b4a-b35c-b22d99406609 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:19 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3786e991-da68-4b4a-b35c-b22d99406609 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d Sep 17 07:29:19 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:19 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3786e991-da68-4b4a-b35c-b22d99406609 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d" returned: 0 in 0.321s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:19 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d is being set with open permissions: ugo+rw Sep 17 07:29:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:19 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d Sep 17 07:29:19 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:19 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d" returned: 0 in 0.277s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:19 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.info Sep 17 07:29:19 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:19 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.info" returned: 0 in 0.269s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:19 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.info is being set with open permissions: ugo+rw Sep 17 07:29:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:19 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.info Sep 17 07:29:19 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:20 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.info" returned: 0 in 0.281s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.180s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:20 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8ac83666-7376-455c-aab9-de797f5792f7 tempest-VolumesExtendTest-880810955 None] Create snapshot completed successfully Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dbe1ee91-0fbb-4c3e-87e0-575a87ed8213 tempest-VolumesExtendTest-880810955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dbe1ee91-0fbb-4c3e-87e0-575a87ed8213 tempest-VolumesExtendTest-880810955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab999c56-4272-49b7-8025-3cd1374dbe79]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dbe1ee91-0fbb-4c3e-87e0-575a87ed8213 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:21 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 Sep 17 07:29:21 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Flow 'volume_create_manager' (4c8d7dda-e704-40a9-96f6-a15ca82a7ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e8cb86-97f9-4964-a851-567a13a8941c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:21 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e8cb86-97f9-4964-a851-567a13a8941c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1176635967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9589ff-bf4e-477c-9e7d-8778db4633d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa0ecfc2121441a0bf204254cc05d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:22Z,use_quota=True,user_id='eed3a1f12ad04239b758673f483e260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6df8a98-a79a-46f7-9744-b9df9a6d9a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6df8a98-a79a-46f7-9744-b9df9a6d9a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95013b12-7501-4c17-acf1-fb69cd2751c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95013b12-7501-4c17-acf1-fb69cd2751c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb9589ff-bf4e-477c-9e7d-8778db4633d9', 'volume_name': 'volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f45af3-9df0-4245-b4de-74753d5aa700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f45af3-9df0-4245-b4de-74753d5aa700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc82d8c-d114-44aa-b40e-e64f383edd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:21 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Volume bb9589ff-bf4e-477c-9e7d-8778db4633d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9', 'volume_size': 1} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dbe1ee91-0fbb-4c3e-87e0-575a87ed8213 tempest-VolumesExtendTest-880810955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609" returned: 0 in 0.488s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dbe1ee91-0fbb-4c3e-87e0-575a87ed8213 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d 2G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dbe1ee91-0fbb-4c3e-87e0-575a87ed8213 tempest-VolumesExtendTest-880810955 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d 2G" returned: 0 in 0.126s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dbe1ee91-0fbb-4c3e-87e0-575a87ed8213 tempest-VolumesExtendTest-880810955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.656s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.149s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1176635967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9589ff-bf4e-477c-9e7d-8778db4633d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa0ecfc2121441a0bf204254cc05d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:22Z,use_quota=True,user_id='eed3a1f12ad04239b758673f483e260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Creating volume bb9589ff-bf4e-477c-9e7d-8778db4633d9 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:29:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:29:22 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:22 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9 1073741824 Sep 17 07:29:22 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:22 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-dbe1ee91-0fbb-4c3e-87e0-575a87ed8213 tempest-VolumesExtendTest-880810955 None] Extend volume completed successfully. Sep 17 07:29:22 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9 1073741824" returned: 0 in 0.441s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:22 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9 Sep 17 07:29:22 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Acquiring lock "cinder-ed425f5c-1d97-4bb1-a637-686aa16c090d-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Lock "cinder-ed425f5c-1d97-4bb1-a637-686aa16c090d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Acquiring lock "cinder-quobyte-3786e991-da68-4b4a-b35c-b22d99406609" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Lock "cinder-quobyte-3786e991-da68-4b4a-b35c-b22d99406609" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Acquiring lock "cinder-quobyte-ed425f5c-1d97-4bb1-a637-686aa16c090d" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Lock "cinder-quobyte-ed425f5c-1d97-4bb1-a637-686aa16c090d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Deleting offline snapshot ed425f5c-1d97-4bb1-a637-686aa16c090d of volume 3786e991-da68-4b4a-b35c-b22d99406609 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] snapshot_file for this snap is: volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[877ee344-6d60-4ee7-b7b3-64e2e05cbc4d]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:22 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9" returned: 0 in 0.294s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc82d8c-d114-44aa-b40e-e64f383edd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a5d7dc-2649-4bac-96fc-5bbcdabb3045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:22 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Volume volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9 (bb9589ff-bf4e-477c-9e7d-8778db4633d9): created successfully Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a5d7dc-2649-4bac-96fc-5bbcdabb3045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Flow 'volume_create_manager' (4c8d7dda-e704-40a9-96f6-a15ca82a7ccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:22 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d Sep 17 07:29:22 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:22 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e0f19d11-807b-408c-afbd-ba802bf47c18 tempest-AbsoluteLimitsTests-555974298 None] Created volume successfully. Sep 17 07:29:23 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d" returned: 0 in 0.402s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3786e991-da68-4b4a-b35c-b22d99406609(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:29:23 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f1b096-d71d-4301-8295-97e8499c7156]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:23 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 Sep 17 07:29:23 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:23 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609" returned: 0 in 0.419s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:23 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d Sep 17 07:29:23 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:23 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d" returned: 0 in 0.413s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:24 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d Sep 17 07:29:24 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:24 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609.ed425f5c-1d97-4bb1-a637-686aa16c090d" returned: 0 in 0.283s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Acquiring lock "cinder-bb9589ff-bf4e-477c-9e7d-8778db4633d9-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Lock "cinder-quobyte-ed425f5c-1d97-4bb1-a637-686aa16c090d" released by "_delete_snapshot" :: held 1.664s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Lock "cinder-bb9589ff-bf4e-477c-9e7d-8778db4633d9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Lock "cinder-quobyte-3786e991-da68-4b4a-b35c-b22d99406609" released by "delete_snapshot" :: held 1.699s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Acquiring lock "cinder-quobyte-bb9589ff-bf4e-477c-9e7d-8778db4633d9" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Lock "cinder-quobyte-bb9589ff-bf4e-477c-9e7d-8778db4633d9" acquired by "delete_volume" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0343c6-58f0-4fe0-a223-2a8d0aa083db]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Created reservations ['29832d44-11f2-4f74-940b-0333f291c86b', 'e1808c8a-44ac-4a62-b524-2201fafb6dd1', '56215adf-12e0-448c-b078-2a099f9d5ddf', 'd4f1ebec-0f63-4b3b-b87c-379c990b791e'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:24 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Delete snapshot completed successfully. Sep 17 07:29:24 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9 Sep 17 07:29:24 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-60154628-a0b8-4ab3-a72b-84d103d1ca46 tempest-VolumesExtendTest-880810955 None] Lock "cinder-ed425f5c-1d97-4bb1-a637-686aa16c090d-delete_snapshot" released by "delete_snapshot" :: held 1.983s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Acquiring lock "cinder-3786e991-da68-4b4a-b35c-b22d99406609-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Lock "cinder-3786e991-da68-4b4a-b35c-b22d99406609-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:24 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Acquiring lock "cinder-quobyte-3786e991-da68-4b4a-b35c-b22d99406609" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9" returned: 0 in 0.462s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Lock "cinder-quobyte-3786e991-da68-4b4a-b35c-b22d99406609" acquired by "delete_volume" :: waited 0.030s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:24 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9 Sep 17 07:29:24 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[045a205a-8253-469a-b446-595e17435e70]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:25 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 Sep 17 07:29:25 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:25 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bb9589ff-bf4e-477c-9e7d-8778db4633d9" returned: 0 in 0.290s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Lock "cinder-quobyte-bb9589ff-bf4e-477c-9e7d-8778db4633d9" released by "delete_volume" :: held 0.820s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Created reservations ['16066a79-3c44-4253-8960-be9a35ec0017', 'f80f593c-c558-4f2c-a719-69f9d4a4ebdf', '9fba38f8-b319-434d-8012-ac9763e960ae', '2d4aeb0a-136e-4049-9bd2-e6e4dc26970c'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:25 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:29:25 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:25 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609" returned: 0 in 0.495s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:29:25 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609 Sep 17 07:29:25 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Flow 'volume_create_manager' (69285acd-5081-45e7-a8af-c1372a8c6921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778000cc-3fdd-483c-aeed-a099d22ae774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778000cc-3fdd-483c-aeed-a099d22ae774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2046006936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808805cf-8355-49cd-a9a0-26f8158ca1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d96cf1e5deff4978bb906119f21593d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:25Z,use_quota=True,user_id='7f87b174848b4717b1ce4cf0c94fe387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df07b62f-0938-479c-bbb8-e4cf5428f690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df07b62f-0938-479c-bbb8-e4cf5428f690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae93616-bd04-4be8-b1a3-479b5245ec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae93616-bd04-4be8-b1a3-479b5245ec24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '808805cf-8355-49cd-a9a0-26f8158ca1d5', 'volume_name': 'volume-808805cf-8355-49cd-a9a0-26f8158ca1d5', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf774556-ae8a-4d40-be45-eb9ac3471f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf774556-ae8a-4d40-be45-eb9ac3471f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b15083b-7ddd-421e-a866-d4c9c9fc6606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:25 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Volume 808805cf-8355-49cd-a9a0-26f8158ca1d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-808805cf-8355-49cd-a9a0-26f8158ca1d5', 'volume_size': 1} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2046006936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808805cf-8355-49cd-a9a0-26f8158ca1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d96cf1e5deff4978bb906119f21593d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:25Z,use_quota=True,user_id='7f87b174848b4717b1ce4cf0c94fe387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Creating volume 808805cf-8355-49cd-a9a0-26f8158ca1d5 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:29:25 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-808805cf-8355-49cd-a9a0-26f8158ca1d5 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:25 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.312s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:25 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-808805cf-8355-49cd-a9a0-26f8158ca1d5 1073741824 Sep 17 07:29:25 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:25 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Deleted volume successfully. Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5af32578-e3a4-42ae-aa92-30aa106d6966 tempest-AbsoluteLimitsTests-555974298 None] Lock "cinder-bb9589ff-bf4e-477c-9e7d-8778db4633d9-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:25 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3786e991-da68-4b4a-b35c-b22d99406609" returned: 0 in 0.307s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Lock "cinder-quobyte-3786e991-da68-4b4a-b35c-b22d99406609" released by "delete_volume" :: held 0.907s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:25 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Created reservations ['1b370ed9-55b3-4c99-8bf7-f700dda8a5ff', 'c2a1e955-4e6d-445b-8711-4fafe0013632', 'b275e47f-8f59-4955-ab7b-d37c94f86243', '83c754f2-a061-46d2-9ae0-4c456297f949'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:26 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:29:26 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:26 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-808805cf-8355-49cd-a9a0-26f8158ca1d5 1073741824" returned: 0 in 0.526s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-808805cf-8355-49cd-a9a0-26f8158ca1d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:26 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-808805cf-8355-49cd-a9a0-26f8158ca1d5 Sep 17 07:29:26 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:26 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.286s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:26 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Deleted volume successfully. Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-606ce5a7-f432-4241-a392-85e16a125248 tempest-VolumesExtendTest-880810955 None] Lock "cinder-3786e991-da68-4b4a-b35c-b22d99406609-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:26 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-808805cf-8355-49cd-a9a0-26f8158ca1d5" returned: 0 in 0.276s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b15083b-7ddd-421e-a866-d4c9c9fc6606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-808805cf-8355-49cd-a9a0-26f8158ca1d5', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8508c9c3-7972-48a6-87ff-b7584a6a52b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:26 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Volume volume-808805cf-8355-49cd-a9a0-26f8158ca1d5 (808805cf-8355-49cd-a9a0-26f8158ca1d5): created successfully Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8508c9c3-7972-48a6-87ff-b7584a6a52b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Flow 'volume_create_manager' (69285acd-5081-45e7-a8af-c1372a8c6921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:26 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-030e6748-1f96-4732-a4a6-e412f5faa6d6 tempest-VolumesNegativeTest-1623638936 None] Created volume successfully. Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Flow 'volume_create_manager' (084beaa8-d521-4813-ac1f-faf087c1efa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5659a3-2181-4f3f-afa8-842892d7e564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5659a3-2181-4f3f-afa8-842892d7e564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-664814506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d194b1a-707d-42b7-826f-7690b44b5c22,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98a5c93f7cbc488fb2c4e0a3c7532f50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:32Z,use_quota=True,user_id='daabc3e13ed94f25b222d5baa5a18286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f79438-1dd3-4928-8dc4-943647cb8318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f79438-1dd3-4928-8dc4-943647cb8318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d335f29-fd7d-404d-af9d-98bb864fb597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d335f29-fd7d-404d-af9d-98bb864fb597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d194b1a-707d-42b7-826f-7690b44b5c22', 'volume_name': 'volume-9d194b1a-707d-42b7-826f-7690b44b5c22', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45be4a22-55c2-4ee3-a8f1-8cf94102d542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45be4a22-55c2-4ee3-a8f1-8cf94102d542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508634dd-6b98-4085-ab9c-0c8fdeca146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:32 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Volume 9d194b1a-707d-42b7-826f-7690b44b5c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d194b1a-707d-42b7-826f-7690b44b5c22', 'volume_size': 1} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-664814506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d194b1a-707d-42b7-826f-7690b44b5c22,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98a5c93f7cbc488fb2c4e0a3c7532f50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:32Z,use_quota=True,user_id='daabc3e13ed94f25b222d5baa5a18286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Creating volume 9d194b1a-707d-42b7-826f-7690b44b5c22 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:29:32 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9d194b1a-707d-42b7-826f-7690b44b5c22 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:32 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9d194b1a-707d-42b7-826f-7690b44b5c22 1073741824 Sep 17 07:29:32 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:32 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9d194b1a-707d-42b7-826f-7690b44b5c22 1073741824" returned: 0 in 0.541s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9d194b1a-707d-42b7-826f-7690b44b5c22 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:32 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9d194b1a-707d-42b7-826f-7690b44b5c22 Sep 17 07:29:32 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:33 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9d194b1a-707d-42b7-826f-7690b44b5c22" returned: 0 in 0.265s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:29:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508634dd-6b98-4085-ab9c-0c8fdeca146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d194b1a-707d-42b7-826f-7690b44b5c22', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3050ef3f-b51e-4f36-be69-3267df76e68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:33 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Volume volume-9d194b1a-707d-42b7-826f-7690b44b5c22 (9d194b1a-707d-42b7-826f-7690b44b5c22): created successfully Sep 17 07:29:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3050ef3f-b51e-4f36-be69-3267df76e68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Flow 'volume_create_manager' (084beaa8-d521-4813-ac1f-faf087c1efa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:33 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-726b2bed-1cbb-4f5e-940c-eb0d25e47f70 tempest-VolumesListTestJSON-1462622340 None] Created volume successfully. Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Flow 'volume_create_manager' (d4ed57cc-a56a-4357-b9c4-c699f426c40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e830ef22-daba-4ae4-b300-895c32ee61ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e830ef22-daba-4ae4-b300-895c32ee61ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1622567940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554ab006-096d-48b2-adc7-ada3acc0064f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98a5c93f7cbc488fb2c4e0a3c7532f50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:35Z,use_quota=True,user_id='daabc3e13ed94f25b222d5baa5a18286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd9beba-50cb-4eff-9059-03a6ae5bd029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd9beba-50cb-4eff-9059-03a6ae5bd029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b049c2c3-854c-4a8f-b18e-6316fd625006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b049c2c3-854c-4a8f-b18e-6316fd625006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '554ab006-096d-48b2-adc7-ada3acc0064f', 'volume_name': 'volume-554ab006-096d-48b2-adc7-ada3acc0064f', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827735d2-13fa-48ea-804d-5e93cae8ec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827735d2-13fa-48ea-804d-5e93cae8ec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398965f9-fb2b-438e-b555-fdbbeaae0811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:35 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Volume 554ab006-096d-48b2-adc7-ada3acc0064f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-554ab006-096d-48b2-adc7-ada3acc0064f', 'volume_size': 1} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1622567940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554ab006-096d-48b2-adc7-ada3acc0064f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98a5c93f7cbc488fb2c4e0a3c7532f50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:35Z,use_quota=True,user_id='daabc3e13ed94f25b222d5baa5a18286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Creating volume 554ab006-096d-48b2-adc7-ada3acc0064f {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:29:35 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:29:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-554ab006-096d-48b2-adc7-ada3acc0064f 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:35 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-554ab006-096d-48b2-adc7-ada3acc0064f 1073741824 Sep 17 07:29:35 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:36 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-554ab006-096d-48b2-adc7-ada3acc0064f 1073741824" returned: 0 in 0.773s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-554ab006-096d-48b2-adc7-ada3acc0064f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:36 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-554ab006-096d-48b2-adc7-ada3acc0064f Sep 17 07:29:36 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:36 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-554ab006-096d-48b2-adc7-ada3acc0064f" returned: 0 in 0.444s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:29:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398965f9-fb2b-438e-b555-fdbbeaae0811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-554ab006-096d-48b2-adc7-ada3acc0064f', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a078e7d3-4631-45ba-9c2f-53046f533696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:36 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Volume volume-554ab006-096d-48b2-adc7-ada3acc0064f (554ab006-096d-48b2-adc7-ada3acc0064f): created successfully Sep 17 07:29:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a078e7d3-4631-45ba-9c2f-53046f533696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:36 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Flow 'volume_create_manager' (d4ed57cc-a56a-4357-b9c4-c699f426c40b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:36 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-00767af1-f4c3-4d6b-9734-c78bc26340da tempest-VolumesListTestJSON-1462622340 None] Created volume successfully. Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Flow 'volume_create_manager' (61cc349e-629a-4c2f-b416-66d00851129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06650ad1-7f66-4cf9-a78e-853bfc14b3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06650ad1-7f66-4cf9-a78e-853bfc14b3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-245805130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105b2b90-443e-4a05-96e0-3b1d6819d3f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98a5c93f7cbc488fb2c4e0a3c7532f50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:38Z,use_quota=True,user_id='daabc3e13ed94f25b222d5baa5a18286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19205bc4-eb79-4261-b38d-7fd7411835fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19205bc4-eb79-4261-b38d-7fd7411835fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e77057-41cc-4808-8608-238c87c9d30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e77057-41cc-4808-8608-238c87c9d30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '105b2b90-443e-4a05-96e0-3b1d6819d3f2', 'volume_name': 'volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a198e4d-f6a8-4962-ab85-058ae1475584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a198e4d-f6a8-4962-ab85-058ae1475584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dbb27fa-f5b2-420c-a966-35d572b0e0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:38 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Volume 105b2b90-443e-4a05-96e0-3b1d6819d3f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2', 'volume_size': 1} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-245805130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105b2b90-443e-4a05-96e0-3b1d6819d3f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98a5c93f7cbc488fb2c4e0a3c7532f50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:38Z,use_quota=True,user_id='daabc3e13ed94f25b222d5baa5a18286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Creating volume 105b2b90-443e-4a05-96e0-3b1d6819d3f2 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:29:38 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:38 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2 1073741824 Sep 17 07:29:38 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:38 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2 1073741824" returned: 0 in 0.760s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:39 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2 Sep 17 07:29:39 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:39 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2" returned: 0 in 0.355s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:39 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:29:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dbb27fa-f5b2-420c-a966-35d572b0e0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80335043-56f6-4b38-b38b-79670e1080e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:39 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Volume volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2 (105b2b90-443e-4a05-96e0-3b1d6819d3f2): created successfully Sep 17 07:29:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80335043-56f6-4b38-b38b-79670e1080e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Flow 'volume_create_manager' (61cc349e-629a-4c2f-b416-66d00851129c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:39 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2eaa5244-b3a8-40ab-9b82-21b84b39aba0 tempest-VolumesListTestJSON-1462622340 None] Created volume successfully. Sep 17 07:29:42 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "cinder-105b2b90-443e-4a05-96e0-3b1d6819d3f2-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:42 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Lock "cinder-105b2b90-443e-4a05-96e0-3b1d6819d3f2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:42 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "cinder-quobyte-105b2b90-443e-4a05-96e0-3b1d6819d3f2" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:42 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Lock "cinder-quobyte-105b2b90-443e-4a05-96e0-3b1d6819d3f2" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:42 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15062d7-61ec-4077-b64a-051f5427e572]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:43 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2 Sep 17 07:29:43 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:43 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2" returned: 0 in 0.475s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:43 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2 Sep 17 07:29:43 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:43 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-105b2b90-443e-4a05-96e0-3b1d6819d3f2" returned: 0 in 0.297s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:43 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Lock "cinder-quobyte-105b2b90-443e-4a05-96e0-3b1d6819d3f2" released by "delete_volume" :: held 0.850s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:43 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Created reservations ['228ba9fa-2235-439b-9c6b-4cfb419df7f2', 'c1f99836-5403-4de4-bc3f-8e63da954a68', '94d1bb23-e7ba-4857-a9f1-e0b46eefd44a', '160e7166-a081-4cb7-bbea-4c4f0262f1d5'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:43 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:29:43 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "cinder-554ab006-096d-48b2-adc7-ada3acc0064f-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Lock "cinder-554ab006-096d-48b2-adc7-ada3acc0064f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "cinder-quobyte-554ab006-096d-48b2-adc7-ada3acc0064f" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Lock "cinder-quobyte-554ab006-096d-48b2-adc7-ada3acc0064f" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[201cfd2c-60d5-4d61-84ba-7968414857d4]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-554ab006-096d-48b2-adc7-ada3acc0064f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:44 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.347s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:44 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Deleted volume successfully. Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-901f3df4-4c7d-4d3c-ba26-79c837703624 tempest-VolumesListTestJSON-1462622340 None] Lock "cinder-105b2b90-443e-4a05-96e0-3b1d6819d3f2-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:44 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-554ab006-096d-48b2-adc7-ada3acc0064f Sep 17 07:29:44 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:44 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-554ab006-096d-48b2-adc7-ada3acc0064f" returned: 0 in 0.400s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-554ab006-096d-48b2-adc7-ada3acc0064f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:44 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-554ab006-096d-48b2-adc7-ada3acc0064f Sep 17 07:29:44 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:29:44 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Flow 'volume_create_manager' (93970450-ed98-472d-99a6-a5be4ce6c88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a57a86-9019-49c7-9880-63338ea4ccff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-554ab006-096d-48b2-adc7-ada3acc0064f" returned: 0 in 0.333s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a57a86-9019-49c7-9880-63338ea4ccff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1169013340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36e941a-11b7-4de0-ab90-e55248533cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4225805755f64a6cbfcf27c224de4159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:45Z,use_quota=True,user_id='fdbaff8bf48c4b5c8d5d1aed3e4070c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af00877c-ee5b-4aff-a3e0-0731090b5881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af00877c-ee5b-4aff-a3e0-0731090b5881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fcc1555-d3b7-47d0-bc9d-5823df503899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fcc1555-d3b7-47d0-bc9d-5823df503899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c36e941a-11b7-4de0-ab90-e55248533cf0', 'volume_name': 'volume-c36e941a-11b7-4de0-ab90-e55248533cf0', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9f4665-4792-4cf2-94ef-1382a64ba9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9f4665-4792-4cf2-94ef-1382a64ba9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e791e431-18d2-40d5-9e63-2eae01fea21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:44 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Volume c36e941a-11b7-4de0-ab90-e55248533cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c36e941a-11b7-4de0-ab90-e55248533cf0', 'volume_size': 1} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1169013340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36e941a-11b7-4de0-ab90-e55248533cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4225805755f64a6cbfcf27c224de4159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:45Z,use_quota=True,user_id='fdbaff8bf48c4b5c8d5d1aed3e4070c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Creating volume c36e941a-11b7-4de0-ab90-e55248533cf0 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:29:44 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Lock "cinder-quobyte-554ab006-096d-48b2-adc7-ada3acc0064f" released by "delete_volume" :: held 0.855s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:45 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0 1073741824 Sep 17 07:29:45 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Created reservations ['029cce6e-8f17-46f3-8561-d56e83990bad', 'abbf0a72-3dec-4a72-9060-31d82833f675', 'a70a4432-0e3b-4cb3-809d-eb7583ca4656', 'aff5d392-1961-4a94-b5ea-01fd6c67e616'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:45 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:29:45 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "cinder-9d194b1a-707d-42b7-826f-7690b44b5c22-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Lock "cinder-9d194b1a-707d-42b7-826f-7690b44b5c22-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "cinder-quobyte-9d194b1a-707d-42b7-826f-7690b44b5c22" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Lock "cinder-quobyte-9d194b1a-707d-42b7-826f-7690b44b5c22" acquired by "delete_volume" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:45 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.360s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:45 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Deleted volume successfully. Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e777a370-781a-4df5-8200-11850bd845dc]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9d194b1a-707d-42b7-826f-7690b44b5c22 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:45 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a1075896-8e93-43de-83b4-c2414af97582 tempest-VolumesListTestJSON-1462622340 None] Lock "cinder-554ab006-096d-48b2-adc7-ada3acc0064f-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0 1073741824" returned: 0 in 0.557s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:45 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0 Sep 17 07:29:45 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:45 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9d194b1a-707d-42b7-826f-7690b44b5c22 Sep 17 07:29:45 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:45 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0" returned: 0 in 0.262s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e791e431-18d2-40d5-9e63-2eae01fea21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c36e941a-11b7-4de0-ab90-e55248533cf0', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9dd402-491c-4b35-aa66-de043ce792cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:45 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Volume volume-c36e941a-11b7-4de0-ab90-e55248533cf0 (c36e941a-11b7-4de0-ab90-e55248533cf0): created successfully Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9dd402-491c-4b35-aa66-de043ce792cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Flow 'volume_create_manager' (93970450-ed98-472d-99a6-a5be4ce6c88b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:45 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a7e7adc6-151c-4a63-b360-2d9d3c2e41bd tempest-VolumesSnapshotTestJSON-998913881 None] Created volume successfully. Sep 17 07:29:45 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9d194b1a-707d-42b7-826f-7690b44b5c22" returned: 0 in 0.426s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9d194b1a-707d-42b7-826f-7690b44b5c22 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:45 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9d194b1a-707d-42b7-826f-7690b44b5c22 Sep 17 07:29:45 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:46 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9d194b1a-707d-42b7-826f-7690b44b5c22" returned: 0 in 0.259s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Lock "cinder-quobyte-9d194b1a-707d-42b7-826f-7690b44b5c22" released by "delete_volume" :: held 0.742s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:46 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Created reservations ['ce13ba94-5681-4ca1-8bae-919d423dcc88', '953bbc8c-2465-481c-8ad0-71f338956380', 'f5b9b5c4-fb8a-4d8d-95a0-4c926363f070', '3aec37ed-13d7-4939-b992-eaefd545af1d'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:46 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:29:46 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:46 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.273s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:46 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:46 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Deleted volume successfully. Sep 17 07:29:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-65e1f327-b293-41da-b259-19ed8fb44cb5 tempest-VolumesListTestJSON-1462622340 None] Lock "cinder-9d194b1a-707d-42b7-826f-7690b44b5c22-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] Creating offline snapshot 11d9b130-d3a4-4676-8987-54b9b16157ce of volume c36e941a-11b7-4de0-ab90-e55248533cf0 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:29:47 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[58748fb6-83b2-4957-b527-e02ebf4a8679]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:47 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0 Sep 17 07:29:47 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:48 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0" returned: 0 in 0.437s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:48 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce 1G Sep 17 07:29:48 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:48 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce 1G" returned: 0 in 0.471s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36e941a-11b7-4de0-ab90-e55248533cf0 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:48 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36e941a-11b7-4de0-ab90-e55248533cf0 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce Sep 17 07:29:48 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:48 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36e941a-11b7-4de0-ab90-e55248533cf0 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce" returned: 0 in 0.342s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:48 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce is being set with open permissions: ugo+rw Sep 17 07:29:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:48 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce Sep 17 07:29:48 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:49 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce" returned: 0 in 0.344s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:49 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.info Sep 17 07:29:49 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:49 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.info" returned: 0 in 0.326s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:49 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.info is being set with open permissions: ugo+rw Sep 17 07:29:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:49 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.info Sep 17 07:29:49 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:49 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.info" returned: 0 in 0.323s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:49 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-036a3ee3-16b1-4b30-90ce-06a93baf8c5b tempest-VolumesSnapshotTestJSON-998913881 None] Create snapshot completed successfully Sep 17 07:29:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Acquiring lock "cinder-808805cf-8355-49cd-a9a0-26f8158ca1d5-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Lock "cinder-808805cf-8355-49cd-a9a0-26f8158ca1d5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Acquiring lock "cinder-quobyte-808805cf-8355-49cd-a9a0-26f8158ca1d5" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Lock "cinder-quobyte-808805cf-8355-49cd-a9a0-26f8158ca1d5" acquired by "delete_volume" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:50 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d271cbbe-2367-425e-aab3-2d0535cab352]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-808805cf-8355-49cd-a9a0-26f8158ca1d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-11d9b130-d3a4-4676-8987-54b9b16157ce-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:50 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-808805cf-8355-49cd-a9a0-26f8158ca1d5 Sep 17 07:29:50 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-11d9b130-d3a4-4676-8987-54b9b16157ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-c36e941a-11b7-4de0-ab90-e55248533cf0" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-c36e941a-11b7-4de0-ab90-e55248533cf0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-11d9b130-d3a4-4676-8987-54b9b16157ce" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-11d9b130-d3a4-4676-8987-54b9b16157ce" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Deleting offline snapshot 11d9b130-d3a4-4676-8987-54b9b16157ce of volume c36e941a-11b7-4de0-ab90-e55248533cf0 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] snapshot_file for this snap is: volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d61b66-00f8-4d08-b68a-5b103fe4dba8]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:51 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce Sep 17 07:29:51 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:51 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-808805cf-8355-49cd-a9a0-26f8158ca1d5" returned: 0 in 0.464s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-808805cf-8355-49cd-a9a0-26f8158ca1d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:51 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-808805cf-8355-49cd-a9a0-26f8158ca1d5 Sep 17 07:29:51 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:51 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce" returned: 0 in 0.446s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c36e941a-11b7-4de0-ab90-e55248533cf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:29:51 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-808805cf-8355-49cd-a9a0-26f8158ca1d5" returned: 0 in 0.272s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7184fb3c-1be3-4426-989d-ac1fa01e1658]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Lock "cinder-quobyte-808805cf-8355-49cd-a9a0-26f8158ca1d5" released by "delete_volume" :: held 0.796s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Created reservations ['9af2a3cd-d215-4eef-85a4-c01a148f0929', 'e8341be9-5e17-4541-a3d2-72b7a0e17cb9', '5256b959-644c-48ce-a5cb-6b1a8d8a546a', 'f82a9683-54b9-4ceb-9bbd-d1c4669782ca'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:51 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0 Sep 17 07:29:51 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:51 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:29:51 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:51 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.291s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:51 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:29:51 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:51 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Deleted volume successfully. Sep 17 07:29:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0" returned: 0 in 0.455s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:52 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce Sep 17 07:29:52 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-34d28625-7faa-4ba5-baef-2b0afc111a6f tempest-VolumesNegativeTest-1623638936 None] Lock "cinder-808805cf-8355-49cd-a9a0-26f8158ca1d5-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:52 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce" returned: 0 in 0.387s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:52 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce Sep 17 07:29:52 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:52 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0.11d9b130-d3a4-4676-8987-54b9b16157ce" returned: 0 in 0.282s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-11d9b130-d3a4-4676-8987-54b9b16157ce" released by "_delete_snapshot" :: held 1.699s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-c36e941a-11b7-4de0-ab90-e55248533cf0" released by "delete_snapshot" :: held 1.729s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:52 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Created reservations ['721d42bf-f47f-4d46-8262-b148c059a978', 'b45ec527-4ebc-4672-bf9f-4bf21ed4d1cd', '2a51b058-63aa-48dc-8950-a4b763fc3448', '069c9ddb-5ea2-4d28-bb54-478929d27613'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:52 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Delete snapshot completed successfully. Sep 17 07:29:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5b4b9531-55df-44c3-a2b8-22ab0d7d1436 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-11d9b130-d3a4-4676-8987-54b9b16157ce-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:UPDATE=201,cinder:SELECT=170,cinder:INSERT=63,cinder:DELETE=16 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Flow 'volume_create_manager' (bb4240f4-e21d-4377-9d87-c26f0e22d635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9da3d28-6c86-4317-8abf-d8f9d6cb67eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9da3d28-6c86-4317-8abf-d8f9d6cb67eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-720294928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c2de44-fe9b-4d4f-8262-6ea1aebc2865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4225805755f64a6cbfcf27c224de4159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:54Z,use_quota=True,user_id='fdbaff8bf48c4b5c8d5d1aed3e4070c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5fe9bb-bedc-4f8b-a4fc-daf184877c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5fe9bb-bedc-4f8b-a4fc-daf184877c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721576fb-65e4-4fc4-a3b0-b7d7c9b04550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721576fb-65e4-4fc4-a3b0-b7d7c9b04550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c2de44-fe9b-4d4f-8262-6ea1aebc2865', 'volume_name': 'volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b37c65-1ae4-4819-903b-a8642f7d6de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b37c65-1ae4-4819-903b-a8642f7d6de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323a95a5-3464-47a3-82fc-666ff88fa91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:53 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Volume 48c2de44-fe9b-4d4f-8262-6ea1aebc2865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865', 'volume_size': 1} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-720294928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c2de44-fe9b-4d4f-8262-6ea1aebc2865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4225805755f64a6cbfcf27c224de4159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:54Z,use_quota=True,user_id='fdbaff8bf48c4b5c8d5d1aed3e4070c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Creating volume 48c2de44-fe9b-4d4f-8262-6ea1aebc2865 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:29:53 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:29:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:53 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 1073741824 Sep 17 07:29:53 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:54 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 1073741824" returned: 0 in 0.500s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:54 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 Sep 17 07:29:54 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:54 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865" returned: 0 in 0.283s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:29:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323a95a5-3464-47a3-82fc-666ff88fa91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be0afd3-c312-46eb-9b04-a9ed887eb4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:54 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Volume volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 (48c2de44-fe9b-4d4f-8262-6ea1aebc2865): created successfully Sep 17 07:29:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be0afd3-c312-46eb-9b04-a9ed887eb4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Flow 'volume_create_manager' (bb4240f4-e21d-4377-9d87-c26f0e22d635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:54 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2f942483-4c73-4334-aa2c-9cfff18a60ea tempest-VolumesSnapshotTestJSON-998913881 None] Created volume successfully. Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:UPDATE=192,cinder:DELETE=18,cinder:SELECT=152,cinder:INSERT=66 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Flow 'volume_create_manager' (599726aa-211b-4a7e-baa4-9aa75b5cd140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bac2dbd-c2e9-4669-834e-d5679ae7ac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bac2dbd-c2e9-4669-834e-d5679ae7ac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-683044740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4109ff78-7d96-4df8-a3a7-128d4cbc611a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb8eba2110414917992c83be7deea645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:56Z,use_quota=True,user_id='9fbd4ef60ffa491ba9dc4ed100bc52b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067ffbe9-4b17-4e93-a0fa-162bddb47c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067ffbe9-4b17-4e93-a0fa-162bddb47c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957d126c-c19f-4967-a0e3-e9bfb4d11c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957d126c-c19f-4967-a0e3-e9bfb4d11c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4109ff78-7d96-4df8-a3a7-128d4cbc611a', 'volume_name': 'volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fd1c39-5c98-4667-87be-9ca3be5b1e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fd1c39-5c98-4667-87be-9ca3be5b1e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c635134-d4dc-4715-bab8-41042c1723df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:55 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Volume 4109ff78-7d96-4df8-a3a7-128d4cbc611a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a', 'volume_size': 1} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-683044740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4109ff78-7d96-4df8-a3a7-128d4cbc611a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb8eba2110414917992c83be7deea645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:29:56Z,use_quota=True,user_id='9fbd4ef60ffa491ba9dc4ed100bc52b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Creating volume 4109ff78-7d96-4df8-a3a7-128d4cbc611a {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:29:55 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:29:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:55 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a 1073741824 Sep 17 07:29:55 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:56 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a 1073741824" returned: 0 in 0.612s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:56 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a Sep 17 07:29:56 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:56 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a" returned: 0 in 0.259s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:29:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.378s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] Creating offline snapshot 32e78b7a-eacd-438f-81f0-1f956c51eedb of volume 48c2de44-fe9b-4d4f-8262-6ea1aebc2865 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:29:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c635134-d4dc-4715-bab8-41042c1723df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6bde61-871b-4f9f-8acc-8ea6c85efdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:29:56 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5845efe1-472f-423d-9e30-607229e22224]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:56 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Volume volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a (4109ff78-7d96-4df8-a3a7-128d4cbc611a): created successfully Sep 17 07:29:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6bde61-871b-4f9f-8acc-8ea6c85efdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:29:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Flow 'volume_create_manager' (599726aa-211b-4a7e-baa4-9aa75b5cd140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:29:56 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-796893ed-20d5-4a6b-982c-429c0429e631 tempest-VolumesSnapshotListTestJSON-1796100627 None] Created volume successfully. Sep 17 07:29:56 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 Sep 17 07:29:56 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:57 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865" returned: 0 in 0.396s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:57 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb 1G Sep 17 07:29:57 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:57 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb 1G" returned: 0 in 0.467s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:57 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb Sep 17 07:29:57 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:57 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb" returned: 0 in 0.331s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:57 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb is being set with open permissions: ugo+rw Sep 17 07:29:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:57 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb Sep 17 07:29:57 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:29:58 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb" returned: 0 in 0.272s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:58 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.info Sep 17 07:29:58 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:58 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.info" returned: 0 in 0.297s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:58 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.info is being set with open permissions: ugo+rw Sep 17 07:29:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:58 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.info Sep 17 07:29:58 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:58 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.info" returned: 0 in 0.257s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:29:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.789s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:29:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] Creating offline snapshot b75b2ef3-f368-4093-a0f5-dd1a2e953808 of volume 4109ff78-7d96-4df8-a3a7-128d4cbc611a {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:29:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-fa4d1d23-1408-411c-b4b1-ac44a8e29f00 tempest-VolumesSnapshotTestJSON-998913881 None] Create snapshot completed successfully Sep 17 07:29:58 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e38d84-12d6-40c3-9f57-e44045e49a33]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:29:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:58 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a Sep 17 07:29:58 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:59 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a" returned: 0 in 0.408s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:59 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 1G Sep 17 07:29:59 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:29:59 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Sep 17 07:29:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 1G" returned: 0 in 0.506s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:29:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:29:59 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 Sep 17 07:29:59 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Flow 'volume_create_manager' (335e58ea-fe5f-4747-8e7c-4e7ee61bb198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07383efb-2251-46de-af2c-71a46ef2f643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07383efb-2251-46de-af2c-71a46ef2f643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-4743963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bafa7ea-5cde-4dbc-b84e-cd52b119aa13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4225805755f64a6cbfcf27c224de4159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:30:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=32e78b7a-eacd-438f-81f0-1f956c51eedb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:30:00Z,use_quota=True,user_id='fdbaff8bf48c4b5c8d5d1aed3e4070c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb2e65f-9bb6-4089-a96a-0657581d5fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb2e65f-9bb6-4089-a96a-0657581d5fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89d9f5d-7fe5-4afb-ad17-068089a96e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89d9f5d-7fe5-4afb-ad17-068089a96e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9bafa7ea-5cde-4dbc-b84e-cd52b119aa13', 'volume_name': 'volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13', 'volume_size': 2, 'snapshot_id': '32e78b7a-eacd-438f-81f0-1f956c51eedb'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5362b7-fb48-4715-bcde-b6847c8facf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:00 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5362b7-fb48-4715-bcde-b6847c8facf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88840ff-e1fe-4f9b-b818-bb3fd9d4a541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:00 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Volume 9bafa7ea-5cde-4dbc-b84e-cd52b119aa13: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13', 'volume_size': 2, 'snapshot_id': '32e78b7a-eacd-438f-81f0-1f956c51eedb'} Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808" returned: 0 in 0.386s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:00 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 is being set with open permissions: ugo+rw Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:00 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 Sep 17 07:30:00 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:00 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808" returned: 0 in 0.239s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:00 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.info Sep 17 07:30:00 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:00 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.info" returned: 0 in 0.366s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:00 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.info is being set with open permissions: ugo+rw Sep 17 07:30:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:00 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.info Sep 17 07:30:00 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:01 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.info" returned: 0 in 0.278s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.317s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.952s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-32e78b7a-eacd-438f-81f0-1f956c51eedb-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13" by "_create_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-32e78b7a-eacd-438f-81f0-1f956c51eedb-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Creating volume 9bafa7ea-5cde-4dbc-b84e-cd52b119aa13 from snapshot 32e78b7a-eacd-438f-81f0-1f956c51eedb {{(pid=86029) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13" by "_copy_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-72e26631-0943-47ad-b5bb-b74b1e0d2698 tempest-VolumesSnapshotListTestJSON-1796100627 None] Create snapshot completed successfully Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] snapshot: 32e78b7a-eacd-438f-81f0-1f956c51eedb, volume: 9bafa7ea-5cde-4dbc-b84e-cd52b119aa13, {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0caf33-ac80-49db-9819-c714b85c724d]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:01 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb Sep 17 07:30:01 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:01 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb" returned: 0 in 0.405s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d81299-00e3-42c3-9df2-acb062b28272]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:01 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 Sep 17 07:30:01 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:02 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865" returned: 0 in 0.394s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] will copy from snapshot at /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 07:30:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Creating direct copy from snapshot {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 07:30:02 devstack cinder-volume[86029]: DEBUG cinder.utils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Path /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13 not found in is_blk_device check {{(pid=86029) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 07:30:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:02 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13 Sep 17 07:30:02 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:30:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:04 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:30:04 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:05 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.508s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:30:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:30:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:30:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:30:09 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13" returned: 0 in 7.628s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:09 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865, size 1024.00 MB, duration 7.63 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:30:09 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Converted 1024.00 MB image at 134.20 MB/s Sep 17 07:30:09 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13 is being set with open permissions: ugo+rw Sep 17 07:30:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:09 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13 Sep 17 07:30:09 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:09 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13" returned: 0 in 0.260s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:09 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13" released by "_copy_volume_from_snapshot" :: held 8.799s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-32e78b7a-eacd-438f-81f0-1f956c51eedb-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13" released by "_create_volume_from_snapshot" :: held 8.894s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.921s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.588s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:10 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] Creating offline snapshot 3437abdf-9e77-4aa2-96e7-7ac9019bd206 of volume 4109ff78-7d96-4df8-a3a7-128d4cbc611a {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:30:10 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb64571-0a6d-40ff-b73b-e571838d6fba]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88840ff-e1fe-4f9b-b818-bb3fd9d4a541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13', 'volume_size': 2, 'snapshot_id': '32e78b7a-eacd-438f-81f0-1f956c51eedb'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e8cc7b-0e85-4cf0-8c06-85c3f36f01dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:10 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Volume volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13 (9bafa7ea-5cde-4dbc-b84e-cd52b119aa13): created successfully Sep 17 07:30:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e8cc7b-0e85-4cf0-8c06-85c3f36f01dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Flow 'volume_create_manager' (335e58ea-fe5f-4747-8e7c-4e7ee61bb198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:30:10 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-668077c7-6f2b-46d5-a8b3-7d551157218c tempest-VolumesSnapshotTestJSON-998913881 None] Created volume successfully. Sep 17 07:30:10 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 Sep 17 07:30:10 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:10 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808" returned: 0 in 0.455s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:10 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:30:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:10 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 1G Sep 17 07:30:10 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:11 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 1G" returned: 0 in 0.569s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6e10df-e33d-4baf-bec1-31c63d95b2c7]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:11 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 Sep 17 07:30:11 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:11 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13 Sep 17 07:30:11 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:11 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206" returned: 0 in 0.333s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:11 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 is being set with open permissions: ugo+rw Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:11 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 Sep 17 07:30:11 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:11 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13" returned: 0 in 0.414s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:11 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13 Sep 17 07:30:11 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:11 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206" returned: 0 in 0.270s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.747s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:11 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e783ca90-af76-480c-a4e5-0cf9aca91e68 tempest-VolumesSnapshotListTestJSON-1796100627 None] Create snapshot completed successfully Sep 17 07:30:11 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13" returned: 0 in 0.266s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13" released by "delete_volume" :: held 0.731s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Created reservations ['e1348118-982c-4991-845a-f56695d87960', 'd0b6cacb-438b-468a-8d1b-70dd7d86a3ae', 'bed9521a-b537-4506-8b22-f4a91816010f', '9a2d75eb-de6f-4dc2-b911-e9a5b02fd016'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:12 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:30:12 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] Creating offline snapshot 5455f211-df47-46e6-883e-94b0d6984914 of volume 4109ff78-7d96-4df8-a3a7-128d4cbc611a {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c74934-d8ac-45ed-92aa-a2e03c41ff3b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-32e78b7a-eacd-438f-81f0-1f956c51eedb-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-32e78b7a-eacd-438f-81f0-1f956c51eedb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-48c2de44-fe9b-4d4f-8262-6ea1aebc2865" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-48c2de44-fe9b-4d4f-8262-6ea1aebc2865" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-32e78b7a-eacd-438f-81f0-1f956c51eedb" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:12 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.389s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:30:12 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Deleted volume successfully. Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-32e78b7a-eacd-438f-81f0-1f956c51eedb" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Deleting offline snapshot 32e78b7a-eacd-438f-81f0-1f956c51eedb of volume 48c2de44-fe9b-4d4f-8262-6ea1aebc2865 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] snapshot_file for this snap is: volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec217a6-4ef6-43b4-a2f7-deff9ae3ab53]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:12 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 Sep 17 07:30:12 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-460b73af-0fd0-4b64-b1c1-f6de1af83e6b tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-9bafa7ea-5cde-4dbc-b84e-cd52b119aa13-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:12 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb Sep 17 07:30:12 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:12 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206" returned: 0 in 0.483s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:12 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 1G Sep 17 07:30:12 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:12 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb" returned: 0 in 0.449s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a155bc-9c72-4266-846a-eb1edd25a60b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:13 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 Sep 17 07:30:13 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:13 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 1G" returned: 0 in 0.627s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:13 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 Sep 17 07:30:13 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:13 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865" returned: 0 in 0.701s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:13 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb Sep 17 07:30:13 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:13 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914" returned: 0 in 0.332s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:13 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 is being set with open permissions: ugo+rw Sep 17 07:30:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:13 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 Sep 17 07:30:13 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:13 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb" returned: 0 in 0.358s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:14 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914" returned: 0 in 0.275s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:14 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb Sep 17 07:30:14 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:14 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-657e2cce-f794-4c5c-a7f0-2ee94bad4f7b tempest-VolumesSnapshotListTestJSON-1796100627 None] Create snapshot completed successfully Sep 17 07:30:14 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865.32e78b7a-eacd-438f-81f0-1f956c51eedb" returned: 0 in 0.265s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-32e78b7a-eacd-438f-81f0-1f956c51eedb" released by "_delete_snapshot" :: held 1.912s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-48c2de44-fe9b-4d4f-8262-6ea1aebc2865" released by "delete_snapshot" :: held 1.955s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:14 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Created reservations ['ad062a80-273a-4010-99ce-90ec4a2eaf0f', '593c0499-5ef9-443f-8b25-59baebe7a8d5', '68dbce3f-17a8-417c-a117-a3766858972c', '5a3bcda2-37d2-4766-aa30-27ee88ccda91'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:14 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Delete snapshot completed successfully. Sep 17 07:30:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7279d680-4bee-4101-a66b-65c91e000825 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-32e78b7a-eacd-438f-81f0-1f956c51eedb-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-48c2de44-fe9b-4d4f-8262-6ea1aebc2865-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-48c2de44-fe9b-4d4f-8262-6ea1aebc2865-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-48c2de44-fe9b-4d4f-8262-6ea1aebc2865" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-48c2de44-fe9b-4d4f-8262-6ea1aebc2865" acquired by "delete_volume" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:14 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72d6187-7502-4df2-be64-7ba88215b6bb]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:14 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 Sep 17 07:30:14 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:15 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865" returned: 0 in 0.419s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:15 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865 Sep 17 07:30:15 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "cinder-5455f211-df47-46e6-883e-94b0d6984914-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-5455f211-df47-46e6-883e-94b0d6984914-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "cinder-quobyte-4109ff78-7d96-4df8-a3a7-128d4cbc611a" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-quobyte-4109ff78-7d96-4df8-a3a7-128d4cbc611a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "cinder-quobyte-5455f211-df47-46e6-883e-94b0d6984914" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-quobyte-5455f211-df47-46e6-883e-94b0d6984914" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Deleting offline snapshot 5455f211-df47-46e6-883e-94b0d6984914 of volume 4109ff78-7d96-4df8-a3a7-128d4cbc611a {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] snapshot_file for this snap is: volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c582e5d-a2aa-4ab6-a1cf-307b92515956]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:15 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-48c2de44-fe9b-4d4f-8262-6ea1aebc2865" returned: 0 in 0.272s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:15 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 Sep 17 07:30:15 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-48c2de44-fe9b-4d4f-8262-6ea1aebc2865" released by "delete_volume" :: held 0.779s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Created reservations ['5531e1ee-083c-4bd9-b751-d514bb7b4aac', '576de7a8-9012-4f0d-8bcb-c0aef1cb2d3e', '65977964-ab53-4386-87af-73cb8a9cc297', '86a6c00a-3bde-40f2-9367-f13746c3096e'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:15 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:30:15 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:15 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914" returned: 0 in 0.418s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[640faad3-e20d-4ed2-8ab8-f5845c1bb78e]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:15 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:15 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 Sep 17 07:30:15 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.315s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:15 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:30:15 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Deleted volume successfully. Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-9a99500b-e6bb-4c53-a5c0-0c6c83a5eda2 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-48c2de44-fe9b-4d4f-8262-6ea1aebc2865-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:16 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206" returned: 0 in 0.463s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:16 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 Sep 17 07:30:16 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Flow 'volume_create_manager' (0cad839f-6fba-463b-a562-f3138d7bf63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bd37be-ade8-4c1f-83cc-87319243177f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bd37be-ade8-4c1f-83cc-87319243177f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1734550244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6644df38-9342-41ed-b9a9-5560a0cdd356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4225805755f64a6cbfcf27c224de4159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:30:16Z,use_quota=True,user_id='fdbaff8bf48c4b5c8d5d1aed3e4070c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d4f6d0-d864-4061-800a-acc3747d67f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d4f6d0-d864-4061-800a-acc3747d67f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6927f3f6-fa67-49f6-9cd9-9db70a4b5d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6927f3f6-fa67-49f6-9cd9-9db70a4b5d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6644df38-9342-41ed-b9a9-5560a0cdd356', 'volume_name': 'volume-6644df38-9342-41ed-b9a9-5560a0cdd356', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6e9b60-97df-4cb5-887d-310e2e827aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6e9b60-97df-4cb5-887d-310e2e827aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7f7d93-8227-4d34-878d-1795f0c13872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:16 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Volume 6644df38-9342-41ed-b9a9-5560a0cdd356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6644df38-9342-41ed-b9a9-5560a0cdd356', 'volume_size': 1} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1734550244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6644df38-9342-41ed-b9a9-5560a0cdd356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4225805755f64a6cbfcf27c224de4159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:30:16Z,use_quota=True,user_id='fdbaff8bf48c4b5c8d5d1aed3e4070c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Creating volume 6644df38-9342-41ed-b9a9-5560a0cdd356 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:30:16 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:16 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 1073741824 Sep 17 07:30:16 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:16 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914" returned: 0 in 0.539s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:16 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914 Sep 17 07:30:16 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:17 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 1073741824" returned: 0 in 0.496s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:17 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.5455f211-df47-46e6-883e-94b0d6984914" returned: 0 in 0.279s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-quobyte-5455f211-df47-46e6-883e-94b0d6984914" released by "_delete_snapshot" :: held 1.822s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-quobyte-4109ff78-7d96-4df8-a3a7-128d4cbc611a" released by "delete_snapshot" :: held 1.854s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:17 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 Sep 17 07:30:17 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Created reservations ['6cd550e3-de6d-40e1-a17e-f790903cbb12', 'c4f4aeb5-f84c-49ac-9b45-a4f2f4cc7a9a', '76ae1af6-e823-460d-8abe-a56c9a0b32a2', '32671e7b-7f60-40eb-b543-2e73f12bce95'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Flow 'volume_create_manager' (5d24f906-c281-49bd-a031-f0cf574a8ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f46bcf1-b0a8-4c10-8f52-7848a200707c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f46bcf1-b0a8-4c10-8f52-7848a200707c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-698065161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30078b58-347d-46a9-992b-024b2d4785ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd74837ca92947368b8371b5d14769bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:30:17Z,use_quota=True,user_id='74ffc736d1294ef5becb2dbe9d3cad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb4d0fe9-b179-41e1-8ee8-0fa10095356a),volume_type_id=eb4d0fe9-b179-41e1-8ee8-0fa10095356a)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bda2945-ce9b-4e2c-952d-9ee11f139835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bda2945-ce9b-4e2c-952d-9ee11f139835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123a2e1e-3827-46c6-a0e4-fd674726d8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123a2e1e-3827-46c6-a0e4-fd674726d8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30078b58-347d-46a9-992b-024b2d4785ec', 'volume_name': 'volume-30078b58-347d-46a9-992b-024b2d4785ec', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a773cc-1937-4eca-a0b4-af2c7fdf2b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a773cc-1937-4eca-a0b4-af2c7fdf2b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56aec690-8192-46a8-8c9a-cb748016c1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:17 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Volume 30078b58-347d-46a9-992b-024b2d4785ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30078b58-347d-46a9-992b-024b2d4785ec', 'volume_size': 1} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:17 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Delete snapshot completed successfully. Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-77443da2-2120-4a08-8a0f-9e53c78f4b2b tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-5455f211-df47-46e6-883e-94b0d6984914-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "cinder-3437abdf-9e77-4aa2-96e7-7ac9019bd206-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:17 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356" returned: 0 in 0.342s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-3437abdf-9e77-4aa2-96e7-7ac9019bd206-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "cinder-quobyte-4109ff78-7d96-4df8-a3a7-128d4cbc611a" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.094s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-698065161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30078b58-347d-46a9-992b-024b2d4785ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd74837ca92947368b8371b5d14769bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:30:17Z,use_quota=True,user_id='74ffc736d1294ef5becb2dbe9d3cad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb4d0fe9-b179-41e1-8ee8-0fa10095356a),volume_type_id=eb4d0fe9-b179-41e1-8ee8-0fa10095356a)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Creating volume 30078b58-347d-46a9-992b-024b2d4785ec {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:30:17 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-30078b58-347d-46a9-992b-024b2d4785ec 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:17 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-30078b58-347d-46a9-992b-024b2d4785ec 1073741824 Sep 17 07:30:17 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7f7d93-8227-4d34-878d-1795f0c13872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6644df38-9342-41ed-b9a9-5560a0cdd356', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2272c69-47a7-47ad-b794-401273559fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-quobyte-4109ff78-7d96-4df8-a3a7-128d4cbc611a" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "cinder-quobyte-3437abdf-9e77-4aa2-96e7-7ac9019bd206" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:17 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Volume volume-6644df38-9342-41ed-b9a9-5560a0cdd356 (6644df38-9342-41ed-b9a9-5560a0cdd356): created successfully Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2272c69-47a7-47ad-b794-401273559fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Flow 'volume_create_manager' (0cad839f-6fba-463b-a562-f3138d7bf63b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-quobyte-3437abdf-9e77-4aa2-96e7-7ac9019bd206" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Deleting offline snapshot 3437abdf-9e77-4aa2-96e7-7ac9019bd206 of volume 4109ff78-7d96-4df8-a3a7-128d4cbc611a {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] snapshot_file for this snap is: volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:30:17 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b256f4d0-27d7-44c9-9760-0c5f7d14d797 tempest-VolumesSnapshotTestJSON-998913881 None] Created volume successfully. Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[12333eb8-74e9-4c91-835b-a31f9e11b0e5]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:17 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 Sep 17 07:30:17 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Flow 'volume_create_manager' (2b57c258-c60e-43f2-806c-cc9649079d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c4563d-249a-4a7e-ad27-b6dc609c3ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c4563d-249a-4a7e-ad27-b6dc609c3ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-19063162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe072b3-41c7-446e-8350-8f5c7b9686b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd74837ca92947368b8371b5d14769bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:30:18Z,use_quota=True,user_id='74ffc736d1294ef5becb2dbe9d3cad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95a92808-4eeb-4d83-902d-51962f73e3c3),volume_type_id=95a92808-4eeb-4d83-902d-51962f73e3c3)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea03158-f945-4aef-851d-4579da39c177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea03158-f945-4aef-851d-4579da39c177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766e7fc7-0a5d-45b6-a5db-7fd3f7099af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766e7fc7-0a5d-45b6-a5db-7fd3f7099af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe072b3-41c7-446e-8350-8f5c7b9686b7', 'volume_name': 'volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce17a8fd-fa53-4b63-83bc-2e61aa8c234e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce17a8fd-fa53-4b63-83bc-2e61aa8c234e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7935092a-7b84-49c1-8d48-a731053913ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:17 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Volume 5fe072b3-41c7-446e-8350-8f5c7b9686b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7', 'volume_size': 1} Sep 17 07:30:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:18 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-30078b58-347d-46a9-992b-024b2d4785ec 1073741824" returned: 0 in 0.528s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-30078b58-347d-46a9-992b-024b2d4785ec {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:18 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-30078b58-347d-46a9-992b-024b2d4785ec Sep 17 07:30:18 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:18 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206" returned: 0 in 0.460s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50c76cf-51be-4859-98ac-0541dafac6af]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:18 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 Sep 17 07:30:18 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:18 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-30078b58-347d-46a9-992b-024b2d4785ec" returned: 0 in 0.283s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-19063162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe072b3-41c7-446e-8350-8f5c7b9686b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd74837ca92947368b8371b5d14769bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:30:18Z,use_quota=True,user_id='74ffc736d1294ef5becb2dbe9d3cad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95a92808-4eeb-4d83-902d-51962f73e3c3),volume_type_id=95a92808-4eeb-4d83-902d-51962f73e3c3)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Creating volume 5fe072b3-41c7-446e-8350-8f5c7b9686b7 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:30:18 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56aec690-8192-46a8-8c9a-cb748016c1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30078b58-347d-46a9-992b-024b2d4785ec', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:18 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7 1073741824 Sep 17 07:30:18 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0556864-2933-436b-94de-5bb6b6878395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:18 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Volume volume-30078b58-347d-46a9-992b-024b2d4785ec (30078b58-347d-46a9-992b-024b2d4785ec): created successfully Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0556864-2933-436b-94de-5bb6b6878395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Flow 'volume_create_manager' (5d24f906-c281-49bd-a031-f0cf574a8ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:30:18 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-90098cd9-bba1-4a46-91fe-cdddedba5f2c tempest-TestInstancesWithCinderVolumes-1870135206 None] Created volume successfully. Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Flow 'volume_create_manager' (12cbf3e8-4d0f-4b02-8161-c2865e710520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68200de8-1169-40f2-945c-ff0319a380ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68200de8-1169-40f2-945c-ff0319a380ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1064566411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd74837ca92947368b8371b5d14769bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:30:19Z,use_quota=True,user_id='74ffc736d1294ef5becb2dbe9d3cad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35de67a6-8e78-4393-a6fc-a8af0651b0e8),volume_type_id=35de67a6-8e78-4393-a6fc-a8af0651b0e8)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a3ce19-b229-484c-90a3-c235b61a1fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a3ce19-b229-484c-90a3-c235b61a1fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0efd8ae-6086-4de0-9a75-a6d2085c216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.image.glance [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Creating Keystone auth plugin from conf {{(pid=86029) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 07:30:18 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808" returned: 0 in 0.556s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:18 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 Sep 17 07:30:18 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0efd8ae-6086-4de0-9a75-a6d2085c216a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d', 'volume_name': 'volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d', 'volume_size': 1, 'image_id': '8a20e650-66a2-488e-8cc0-832f793b1a87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a20e650-66a2-488e-8cc0-832f793b1a87', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1818226857', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd74837ca92947368b8371b5d14769bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a20e650-66a2-488e-8cc0-832f793b1a87', 'created_at': datetime.datetime(2026, 9, 17, 5, 30, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 30, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a20e650-66a2-488e-8cc0-832f793b1a87/file', 'properties': {}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1a2d87-db86-4483-9911-0424a3dfa54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1a2d87-db86-4483-9911-0424a3dfa54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b68367-90e5-46fe-a657-4f60e7bdce06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:18 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Volume 9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d', 'volume_size': 1, 'image_id': '8a20e650-66a2-488e-8cc0-832f793b1a87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a20e650-66a2-488e-8cc0-832f793b1a87', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1818226857', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd74837ca92947368b8371b5d14769bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a20e650-66a2-488e-8cc0-832f793b1a87', 'created_at': datetime.datetime(2026, 9, 17, 5, 30, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 30, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a20e650-66a2-488e-8cc0-832f793b1a87/file', 'properties': {}}, 'image_service': } Sep 17 07:30:18 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Trying to clone 9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d from image 8a20e650-66a2-488e-8cc0-832f793b1a87 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8a20e650-66a2-488e-8cc0-832f793b1a87', 'metadata': {}}]). {{(pid=86029) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 07:30:19 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7 1073741824" returned: 0 in 0.639s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:19 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7 Sep 17 07:30:19 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:19 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206" returned: 0 in 0.479s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:19 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206 Sep 17 07:30:19 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:19 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7" returned: 0 in 0.259s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.456s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7935092a-7b84-49c1-8d48-a731053913ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67419aa5-a620-49f0-8da0-74865a3065ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] Creating offline snapshot 436852e0-a9f2-4fc6-9d1b-4beadb93e078 of volume 6644df38-9342-41ed-b9a9-5560a0cdd356 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:30:19 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Volume volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7 (5fe072b3-41c7-446e-8350-8f5c7b9686b7): created successfully Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67419aa5-a620-49f0-8da0-74865a3065ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Flow 'volume_create_manager' (2b57c258-c60e-43f2-806c-cc9649079d85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed12a016-8857-4f12-a00a-a63b97529015]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:19 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-092c064b-c1d6-404c-9bb7-47396d8488f5 tempest-TestInstancesWithCinderVolumes-1870135206 None] Created volume successfully. Sep 17 07:30:19 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.3437abdf-9e77-4aa2-96e7-7ac9019bd206" returned: 0 in 0.315s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:19 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 Sep 17 07:30:19 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-quobyte-3437abdf-9e77-4aa2-96e7-7ac9019bd206" released by "_delete_snapshot" :: held 1.951s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-quobyte-4109ff78-7d96-4df8-a3a7-128d4cbc611a" released by "delete_snapshot" :: held 2.001s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Created reservations ['2327fe4e-6402-4550-9207-bf2b53ba651f', '11b310d0-44e2-47b4-b606-bab809cc0380', '386cbc01-ff18-493d-96a0-7db4ba2e4cc5', 'b8346cff-6fbb-4cd8-8d8f-cfb9b68f2610'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:19 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Delete snapshot completed successfully. Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-531f6c0f-a05f-4c14-a1e1-42025a9c7fc8 tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-3437abdf-9e77-4aa2-96e7-7ac9019bd206-delete_snapshot" released by "delete_snapshot" :: held 2.207s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:19 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356" returned: 0 in 0.417s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:19 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 1G Sep 17 07:30:19 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:20 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 1G" returned: 0 in 0.416s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6644df38-9342-41ed-b9a9-5560a0cdd356 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:20 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6644df38-9342-41ed-b9a9-5560a0cdd356 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 Sep 17 07:30:20 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:20 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6644df38-9342-41ed-b9a9-5560a0cdd356 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078" returned: 0 in 0.315s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:20 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 is being set with open permissions: ugo+rw Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:20 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 Sep 17 07:30:20 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "cinder-b75b2ef3-f368-4093-a0f5-dd1a2e953808-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-b75b2ef3-f368-4093-a0f5-dd1a2e953808-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "cinder-quobyte-4109ff78-7d96-4df8-a3a7-128d4cbc611a" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-quobyte-4109ff78-7d96-4df8-a3a7-128d4cbc611a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "cinder-quobyte-b75b2ef3-f368-4093-a0f5-dd1a2e953808" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-quobyte-b75b2ef3-f368-4093-a0f5-dd1a2e953808" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Deleting offline snapshot b75b2ef3-f368-4093-a0f5-dd1a2e953808 of volume 4109ff78-7d96-4df8-a3a7-128d4cbc611a {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] snapshot_file for this snap is: volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:30:20 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078" returned: 0 in 0.263s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ddc63f-2646-4c7e-91a4-7c0cf7339114]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:20 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.info Sep 17 07:30:20 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:20 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 Sep 17 07:30:20 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:21 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.info" returned: 0 in 0.281s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:21 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.info is being set with open permissions: ugo+rw Sep 17 07:30:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:21 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.info Sep 17 07:30:21 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:21 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808" returned: 0 in 0.420s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:30:21 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[97801f19-70f9-425e-8255-117f1a404913]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:21 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a Sep 17 07:30:21 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:21 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.info" returned: 0 in 0.285s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:21 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-754c1eb6-8fd8-4092-8c7d-0e1072754578 tempest-VolumesSnapshotTestJSON-998913881 None] Create snapshot completed successfully Sep 17 07:30:21 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a" returned: 0 in 0.419s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:21 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 Sep 17 07:30:21 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:22 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808" returned: 0 in 0.388s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:22 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808 Sep 17 07:30:22 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:22 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a.b75b2ef3-f368-4093-a0f5-dd1a2e953808" returned: 0 in 0.280s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-quobyte-b75b2ef3-f368-4093-a0f5-dd1a2e953808" released by "_delete_snapshot" :: held 1.657s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-quobyte-4109ff78-7d96-4df8-a3a7-128d4cbc611a" released by "delete_snapshot" :: held 1.688s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Created reservations ['9fd614c9-0ac9-46ec-ac1e-e6dd5622e6ea', '26a3ef26-40f3-4596-a9b1-d83274dfd1bc', '9588d16e-25bc-42de-87e8-21fb65365475', 'cb81423c-19d5-471b-a47b-c4cc875c3e49'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Flow 'volume_create_manager' (0fa97433-ae73-48bd-b417-f7c94f10b5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f8b4b0-5e64-4eab-a64c-e819f9fdb60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f8b4b0-5e64-4eab-a64c-e819f9fdb60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2082011765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc8dbe3-7d21-4d19-898e-68fc34a7eb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4225805755f64a6cbfcf27c224de4159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=436852e0-a9f2-4fc6-9d1b-4beadb93e078,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:30:23Z,use_quota=True,user_id='fdbaff8bf48c4b5c8d5d1aed3e4070c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6553ca-16e8-4b9e-83b6-816a8d57f98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6553ca-16e8-4b9e-83b6-816a8d57f98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c33dec-e9d2-48c9-a5f7-84a5b04be46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c33dec-e9d2-48c9-a5f7-84a5b04be46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ecc8dbe3-7d21-4d19-898e-68fc34a7eb52', 'volume_name': 'volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52', 'volume_size': 1, 'snapshot_id': '436852e0-a9f2-4fc6-9d1b-4beadb93e078'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b551757-04fa-4bb3-a25e-0e3d8cb8481e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b551757-04fa-4bb3-a25e-0e3d8cb8481e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47da0321-88b1-497d-8506-1315bf2e046e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:22 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Volume ecc8dbe3-7d21-4d19-898e-68fc34a7eb52: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52', 'volume_size': 1, 'snapshot_id': '436852e0-a9f2-4fc6-9d1b-4beadb93e078'} Sep 17 07:30:22 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Delete snapshot completed successfully. Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-436852e0-a9f2-4fc6-9d1b-4beadb93e078-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52" by "_create_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0bc45006-d610-44a0-bd87-9d02e1d89edb tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-b75b2ef3-f368-4093-a0f5-dd1a2e953808-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-436852e0-a9f2-4fc6-9d1b-4beadb93e078-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Creating volume ecc8dbe3-7d21-4d19-898e-68fc34a7eb52 from snapshot 436852e0-a9f2-4fc6-9d1b-4beadb93e078 {{(pid=86029) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52" by "_copy_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] snapshot: 436852e0-a9f2-4fc6-9d1b-4beadb93e078, volume: ecc8dbe3-7d21-4d19-898e-68fc34a7eb52, {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68a8acb-771f-414b-8810-4ef148f8cec2]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:22 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 Sep 17 07:30:22 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "cinder-4109ff78-7d96-4df8-a3a7-128d4cbc611a-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-4109ff78-7d96-4df8-a3a7-128d4cbc611a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "cinder-quobyte-4109ff78-7d96-4df8-a3a7-128d4cbc611a" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-quobyte-4109ff78-7d96-4df8-a3a7-128d4cbc611a" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[403fe95d-fd2e-4b87-9022-4ba9668a85c3]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:23 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a Sep 17 07:30:23 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:23 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078" returned: 0 in 0.411s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6644df38-9342-41ed-b9a9-5560a0cdd356(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8a20e650-66a2-488e-8cc0-832f793b1a87_i_yw01a6devstack@QuobyteHD, size 20.69 MB, duration 4.26 sec {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 07:30:23 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Image download 20.69 MB at 4.86 MB/s Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0235dde6-9cec-48c3-be46-a5c3d4a1ccd7]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ff18c7-8eeb-4c34-b442-25f29e8df829]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a20e650-66a2-488e-8cc0-832f793b1a87_i_yw01a6devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:23 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 Sep 17 07:30:23 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:23 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a20e650-66a2-488e-8cc0-832f793b1a87_i_yw01a6devstack@QuobyteHD Sep 17 07:30:23 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:23 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a" returned: 0 in 0.424s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:23 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a Sep 17 07:30:23 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:23 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356" returned: 0 in 0.391s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] will copy from snapshot at /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Creating direct copy from snapshot {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG cinder.utils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Path /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52 not found in is_blk_device check {{(pid=86029) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:23 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a20e650-66a2-488e-8cc0-832f793b1a87_i_yw01a6devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Temporary image 8a20e650-66a2-488e-8cc0-832f793b1a87 is fetched for user 74ffc736d1294ef5becb2dbe9d3cad68. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 07:30:23 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52 Sep 17 07:30:23 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[94160a7b-341d-4388-a87a-c5d02cbf3d3c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a20e650-66a2-488e-8cc0-832f793b1a87_i_yw01a6devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:23 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4109ff78-7d96-4df8-a3a7-128d4cbc611a" returned: 0 in 0.283s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-quobyte-4109ff78-7d96-4df8-a3a7-128d4cbc611a" released by "delete_volume" :: held 0.782s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:23 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a20e650-66a2-488e-8cc0-832f793b1a87_i_yw01a6devstack@QuobyteHD Sep 17 07:30:23 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Created reservations ['f822c50f-22e9-4ec2-a9b5-65bdcc7c0812', '90cd2a15-8901-467d-9913-6c4a4dbf258b', '9cb8b712-d3bb-458f-a251-472eb2de7bb3', 'f1cfc584-c361-46e6-9e88-68994c8d3a73'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:23 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:30:23 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:24 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a20e650-66a2-488e-8cc0-832f793b1a87_i_yw01a6devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:24 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.348s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:24 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:30:24 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Deleted volume successfully. Sep 17 07:30:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6e9c0b5f-f2fe-4760-bfd3-3719c123f8ca tempest-VolumesSnapshotListTestJSON-1796100627 None] Lock "cinder-4109ff78-7d96-4df8-a3a7-128d4cbc611a-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:30 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52" returned: 0 in 7.030s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356, size 1024.00 MB, duration 7.03 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:30:30 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Converted 1024.00 MB image at 145.65 MB/s Sep 17 07:30:30 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52 is being set with open permissions: ugo+rw Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:30 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52 Sep 17 07:30:30 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Flow 'volume_create_manager' (2805a090-7426-4c6e-85fa-e691df77619d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e9b7f7-e2c3-4466-9687-535371907638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e9b7f7-e2c3-4466-9687-535371907638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1824261621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf681c0-1611-4f17-8f23-b4cc6d852c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53fba34fbd8d40b1859c3b355b42144c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:30:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:30:31Z,use_quota=True,user_id='93542b2bba914a9884bf2b4da97aa7f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49d2c31-ac4e-4826-ab64-a8c7a79d9bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49d2c31-ac4e-4826-ab64-a8c7a79d9bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9b285c-bcb8-4fe7-b490-efb080ac74de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9b285c-bcb8-4fe7-b490-efb080ac74de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bf681c0-1611-4f17-8f23-b4cc6d852c7a', 'volume_name': 'volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a', 'volume_size': 2}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5d3cf2-1f7d-4907-b0d9-7fc8a3061844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5d3cf2-1f7d-4907-b0d9-7fc8a3061844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253f5c0e-a114-4aa8-944a-17594f0dfe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:30 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Volume 6bf681c0-1611-4f17-8f23-b4cc6d852c7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a', 'volume_size': 2} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:30 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52" returned: 0 in 0.243s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52" released by "_copy_volume_from_snapshot" :: held 8.177s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-436852e0-a9f2-4fc6-9d1b-4beadb93e078-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52" released by "_create_volume_from_snapshot" :: held 8.232s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.250s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.849s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1064566411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd74837ca92947368b8371b5d14769bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:30:19Z,use_quota=True,user_id='74ffc736d1294ef5becb2dbe9d3cad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35de67a6-8e78-4393-a6fc-a8af0651b0e8),volume_type_id=35de67a6-8e78-4393-a6fc-a8af0651b0e8)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Creating volume 9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:30:30 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:30:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:31 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d 1073741824 Sep 17 07:30:31 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47da0321-88b1-497d-8506-1315bf2e046e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52', 'volume_size': 1, 'snapshot_id': '436852e0-a9f2-4fc6-9d1b-4beadb93e078'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd8593f-9bc4-481d-9321-38a55ad42043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:31 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Volume volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52 (ecc8dbe3-7d21-4d19-898e-68fc34a7eb52): created successfully Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd8593f-9bc4-481d-9321-38a55ad42043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Flow 'volume_create_manager' (0fa97433-ae73-48bd-b417-f7c94f10b5a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:30:31 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-6003cc5b-f642-40ad-be90-6ccfa6ba6cfb tempest-VolumesSnapshotTestJSON-998913881 None] Created volume successfully. Sep 17 07:30:31 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d 1073741824" returned: 0 in 0.426s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:31 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d Sep 17 07:30:31 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1d376c-ce79-40eb-b987-d80c7046087f]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:31 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52 Sep 17 07:30:31 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:31 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d" returned: 0 in 0.286s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.879s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1824261621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf681c0-1611-4f17-8f23-b4cc6d852c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53fba34fbd8d40b1859c3b355b42144c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:30:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:30:31Z,use_quota=True,user_id='93542b2bba914a9884bf2b4da97aa7f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Creating volume 6bf681c0-1611-4f17-8f23-b4cc6d852c7a {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:30:31 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a 2147483648 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:31 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a 2147483648 Sep 17 07:30:31 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Attempting download of 8a20e650-66a2-488e-8cc0-832f793b1a87 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a20e650-66a2-488e-8cc0-832f793b1a87', 'metadata': {}}])) to volume 9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c8cd54-3576-464d-a9be-3cb8153d40d9]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a20e650-66a2-488e-8cc0-832f793b1a87_hc9cio92 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:31 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52" returned: 0 in 0.372s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:31 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52 Sep 17 07:30:31 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:31 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a20e650-66a2-488e-8cc0-832f793b1a87_hc9cio92 Sep 17 07:30:31 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:32 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52" returned: 0 in 0.256s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52" released by "delete_volume" :: held 0.679s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:32 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a20e650-66a2-488e-8cc0-832f793b1a87_hc9cio92" returned: 0 in 0.392s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a20e650-66a2-488e-8cc0-832f793b1a87_hc9cio92 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:32 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Created reservations ['eea16243-e553-4ef7-88f0-6b2bbb7667ec', '2f81f7b3-ee08-4e76-bf4b-113e0dfeb9a2', '5526e5e3-76b0-4afc-a41d-3e6043c8ac3e', 'ab0a5673-5799-40bb-8f50-bfeb72a1408a'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a 2147483648" returned: 0 in 0.509s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:32 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a Sep 17 07:30:32 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:32 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a20e650-66a2-488e-8cc0-832f793b1a87_hc9cio92 Sep 17 07:30:32 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:32 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:30:32 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:32 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a" returned: 0 in 0.274s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:32 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a20e650-66a2-488e-8cc0-832f793b1a87_hc9cio92" returned: 1 in 0.359s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a20e650-66a2-488e-8cc0-832f793b1a87_hc9cio92' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9c7023-a062-4d05-9f80-26dece1de667]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a20e650-66a2-488e-8cc0-832f793b1a87_i_yw01a6devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253f5c0e-a114-4aa8-944a-17594f0dfe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a', 'volume_size': 2}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a733a2ee-b209-4e65-b4f2-25c539c50066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:32 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.290s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:30:32 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Deleted volume successfully. Sep 17 07:30:32 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Volume volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a (6bf681c0-1611-4f17-8f23-b4cc6d852c7a): created successfully Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a733a2ee-b209-4e65-b4f2-25c539c50066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Flow 'volume_create_manager' (2805a090-7426-4c6e-85fa-e691df77619d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-436852e0-a9f2-4fc6-9d1b-4beadb93e078-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a3a08380-edf4-48d4-b8bc-7f2fab2c3eca tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-ecc8dbe3-7d21-4d19-898e-68fc34a7eb52-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:32 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-43bb0a3e-58c5-498c-a1d2-0726ae5e51fe tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Created volume successfully. Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-436852e0-a9f2-4fc6-9d1b-4beadb93e078-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-6644df38-9342-41ed-b9a9-5560a0cdd356" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:32 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a20e650-66a2-488e-8cc0-832f793b1a87_i_yw01a6devstack@QuobyteHD Sep 17 07:30:32 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-6644df38-9342-41ed-b9a9-5560a0cdd356" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-436852e0-a9f2-4fc6-9d1b-4beadb93e078" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-436852e0-a9f2-4fc6-9d1b-4beadb93e078" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Deleting offline snapshot 436852e0-a9f2-4fc6-9d1b-4beadb93e078 of volume 6644df38-9342-41ed-b9a9-5560a0cdd356 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] snapshot_file for this snap is: volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c9f243-8ce9-4a49-a969-d6c9ff57e5b9]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:32 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 Sep 17 07:30:32 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:32 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a20e650-66a2-488e-8cc0-832f793b1a87_i_yw01a6devstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] 8a20e650-66a2-488e-8cc0-832f793b1a87 was qcow2, converting to qcow2 {{(pid=86029) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 07:30:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a20e650-66a2-488e-8cc0-832f793b1a87_i_yw01a6devstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:32 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a20e650-66a2-488e-8cc0-832f793b1a87_i_yw01a6devstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d Sep 17 07:30:32 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Creating offline snapshot e1b71605-1628-4ba4-9944-434258d03a5e of volume 6bf681c0-1611-4f17-8f23-b4cc6d852c7a {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ac16c9-5735-4b19-b439-1e53e4397508]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:33 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a Sep 17 07:30:33 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:33 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078" returned: 0 in 0.433s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6644df38-9342-41ed-b9a9-5560a0cdd356(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ec59d1-d846-4321-8014-4b3fe95d279b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:33 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 Sep 17 07:30:33 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:33 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a" returned: 0 in 0.389s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e 2G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:33 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e 2G Sep 17 07:30:33 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:33 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356" returned: 0 in 0.674s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:33 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 Sep 17 07:30:33 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:33 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e 2G" returned: 0 in 0.533s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:34 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e Sep 17 07:30:34 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:34 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e" returned: 0 in 0.334s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:34 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e is being set with open permissions: ugo+rw Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:34 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e Sep 17 07:30:34 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:34 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078" returned: 0 in 0.433s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:34 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078 Sep 17 07:30:34 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:34 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e" returned: 0 in 0.269s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:34 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356.436852e0-a9f2-4fc6-9d1b-4beadb93e078" returned: 0 in 0.294s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:34 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.info Sep 17 07:30:34 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-436852e0-a9f2-4fc6-9d1b-4beadb93e078" released by "_delete_snapshot" :: held 1.959s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-6644df38-9342-41ed-b9a9-5560a0cdd356" released by "delete_snapshot" :: held 1.984s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Created reservations ['42dd819b-82fa-4e18-9941-52137efaf52c', '198c5c59-3ab7-42c0-85ad-02ed4eacab75', '1169e8d3-2822-4d49-a8d2-8573dca71575', '7712884c-4584-4c5e-95b0-c450d8a0e35e'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:34 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Delete snapshot completed successfully. Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-12e1c210-cba0-4338-9dfa-a2990d4fee6a tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-436852e0-a9f2-4fc6-9d1b-4beadb93e078-delete_snapshot" released by "delete_snapshot" :: held 2.165s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:34 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.info" returned: 0 in 0.296s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:34 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.info is being set with open permissions: ugo+rw Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:34 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a20e650-66a2-488e-8cc0-832f793b1a87_i_yw01a6devstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d" returned: 0 in 1.992s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8a20e650-66a2-488e-8cc0-832f793b1a87_i_yw01a6devstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:30:34 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Converted 112.00 MB image at 56.17 MB/s Sep 17 07:30:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:34 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.info Sep 17 07:30:34 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:34 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d 1G Sep 17 07:30:34 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:35 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.info" returned: 0 in 0.250s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:35 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a7efa441-53b1-4c32-be17-e5d086a8f41e tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Create snapshot completed successfully Sep 17 07:30:35 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d 1G" returned: 0 in 0.329s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:35 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Downloaded image 8a20e650-66a2-488e-8cc0-832f793b1a87 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a20e650-66a2-488e-8cc0-832f793b1a87', 'metadata': {}}])) to volume 9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d successfully. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 07:30:35 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Temporary image 8a20e650-66a2-488e-8cc0-832f793b1a87 for user 74ffc736d1294ef5becb2dbe9d3cad68 is deleted. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 07:30:35 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Marking volume 9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d as bootable. {{(pid=86029) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 07:30:35 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Copying metadata from image 8a20e650-66a2-488e-8cc0-832f793b1a87 to 9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d. {{(pid=86029) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 07:30:35 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Creating volume glance metadata for volume 9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d backed by image 8a20e650-66a2-488e-8cc0-832f793b1a87 with: {'image_id': '8a20e650-66a2-488e-8cc0-832f793b1a87', 'image_name': 'tempest-scenario-img--1818226857', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86029) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 07:30:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b68367-90e5-46fe-a657-4f60e7bdce06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d', 'volume_size': 1, 'image_id': '8a20e650-66a2-488e-8cc0-832f793b1a87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a20e650-66a2-488e-8cc0-832f793b1a87', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1818226857', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd74837ca92947368b8371b5d14769bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a20e650-66a2-488e-8cc0-832f793b1a87', 'created_at': datetime.datetime(2026, 9, 17, 5, 30, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 30, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a20e650-66a2-488e-8cc0-832f793b1a87/file', 'properties': {}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb8892b-4b96-4e0c-818b-401ccc815956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:30:35 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Volume volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d (9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d): created successfully Sep 17 07:30:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb8892b-4b96-4e0c-818b-401ccc815956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:30:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Flow 'volume_create_manager' (12cbf3e8-4d0f-4b02-8161-c2865e710520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:30:35 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d220800e-19ed-4e20-9a89-7703a83db75d tempest-TestInstancesWithCinderVolumes-1870135206 None] Created volume successfully. Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-6644df38-9342-41ed-b9a9-5560a0cdd356-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-6644df38-9342-41ed-b9a9-5560a0cdd356-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-6644df38-9342-41ed-b9a9-5560a0cdd356" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-6644df38-9342-41ed-b9a9-5560a0cdd356" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a2c30e-3df9-4517-891f-904af39dee6d]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Acquiring lock "cinder-e1b71605-1628-4ba4-9944-434258d03a5e-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "cinder-e1b71605-1628-4ba4-9944-434258d03a5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Acquiring lock "cinder-quobyte-6bf681c0-1611-4f17-8f23-b4cc6d852c7a" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "cinder-quobyte-6bf681c0-1611-4f17-8f23-b4cc6d852c7a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Acquiring lock "cinder-quobyte-e1b71605-1628-4ba4-9944-434258d03a5e" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:36 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 Sep 17 07:30:36 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "cinder-quobyte-e1b71605-1628-4ba4-9944-434258d03a5e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Deleting offline snapshot e1b71605-1628-4ba4-9944-434258d03a5e of volume 6bf681c0-1611-4f17-8f23-b4cc6d852c7a {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] snapshot_file for this snap is: volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[60887dc8-bbc5-42db-a1c0-39520a70269a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:36 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e Sep 17 07:30:36 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:36 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356" returned: 0 in 0.434s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:36 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356 Sep 17 07:30:36 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:36 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e" returned: 0 in 0.428s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceec6c1-4d96-497e-b0d1-82e551ed8217]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:36 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6644df38-9342-41ed-b9a9-5560a0cdd356" returned: 0 in 0.283s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-6644df38-9342-41ed-b9a9-5560a0cdd356" released by "delete_volume" :: held 0.802s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:36 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a Sep 17 07:30:36 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Created reservations ['3b7722ac-4304-4dc8-8400-129bb6e162ea', 'c9f3bdc4-c0a6-4962-b5ee-781c253c2793', 'c9644357-8356-4a6b-92d2-09fa54b18e19', 'd5741dc3-54e8-470e-8f57-b97308c7d219'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:37 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:30:37 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:37 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a" returned: 0 in 0.540s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:37 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e Sep 17 07:30:37 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-c36e941a-11b7-4de0-ab90-e55248533cf0-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-c36e941a-11b7-4de0-ab90-e55248533cf0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "cinder-quobyte-c36e941a-11b7-4de0-ab90-e55248533cf0" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:37 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-c36e941a-11b7-4de0-ab90-e55248533cf0" acquired by "delete_volume" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.603s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:30:37 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Deleted volume successfully. Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4443352-b33d-4fd7-a3a8-f702bd913693]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d4427250-325f-4569-8127-7fdf3557b640 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-6644df38-9342-41ed-b9a9-5560a0cdd356-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:37 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0 Sep 17 07:30:37 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:37 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e" returned: 0 in 0.486s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:37 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e Sep 17 07:30:37 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:38 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0" returned: 0 in 0.408s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:38 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0 Sep 17 07:30:38 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:38 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a.e1b71605-1628-4ba4-9944-434258d03a5e" returned: 0 in 0.287s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "cinder-quobyte-e1b71605-1628-4ba4-9944-434258d03a5e" released by "_delete_snapshot" :: held 1.895s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "cinder-quobyte-6bf681c0-1611-4f17-8f23-b4cc6d852c7a" released by "delete_snapshot" :: held 1.924s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Created reservations ['2781d8e4-4ed8-4fe8-97b6-4def07af655c', 'bf76fe2a-1704-40ff-b40a-752eb9b07ecc', '1edde1e1-df2d-49ec-a77a-f88e0b759c66', 'b75adb8a-6d5a-4a90-b86f-0c58cff5db71'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:38 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Delete snapshot completed successfully. Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-23d02ec6-f4a7-4dc8-a817-1745eb648154 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "cinder-e1b71605-1628-4ba4-9944-434258d03a5e-delete_snapshot" released by "delete_snapshot" :: held 2.090s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:38 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c36e941a-11b7-4de0-ab90-e55248533cf0" returned: 0 in 0.300s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-quobyte-c36e941a-11b7-4de0-ab90-e55248533cf0" released by "delete_volume" :: held 0.804s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Created reservations ['9b46c96b-ef24-413f-8555-a4219b8e2a1b', '6a39da75-0a8e-4448-b135-1a795c1253f8', '5a6f7a58-cea4-43e5-bfe2-c99893f8a05c', 'c85082ed-aae3-4f49-b3eb-e98ba836a6b5'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:38 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:30:38 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Acquiring lock "cinder-6bf681c0-1611-4f17-8f23-b4cc6d852c7a-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "cinder-6bf681c0-1611-4f17-8f23-b4cc6d852c7a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Acquiring lock "cinder-quobyte-6bf681c0-1611-4f17-8f23-b4cc6d852c7a" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "cinder-quobyte-6bf681c0-1611-4f17-8f23-b4cc6d852c7a" acquired by "delete_volume" :: waited 0.035s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[476e75c3-d188-46df-938f-47ab2eed9e76]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:30:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:39 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.429s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:39 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:30:39 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Deleted volume successfully. Sep 17 07:30:39 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a Sep 17 07:30:39 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-32d0b280-746b-4055-ac2a-66910032e4f1 tempest-VolumesSnapshotTestJSON-998913881 None] Lock "cinder-c36e941a-11b7-4de0-ab90-e55248533cf0-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-b8818333-e8b3-4aef-a726-189c54367adf req-8730fa48-b19d-4684-8543-a3710915ebe0 tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-b8818333-e8b3-4aef-a726-189c54367adf req-8730fa48-b19d-4684-8543-a3710915ebe0 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-b8818333-e8b3-4aef-a726-189c54367adf req-8730fa48-b19d-4684-8543-a3710915ebe0 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-b8818333-e8b3-4aef-a726-189c54367adf req-8730fa48-b19d-4684-8543-a3710915ebe0 tempest-TestInstancesWithCinderVolumes-1870135206 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89cd87ff-a46a-4dc8-9f41-85589190ceb2', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:30:39 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-b8818333-e8b3-4aef-a726-189c54367adf req-8730fa48-b19d-4684-8543-a3710915ebe0 tempest-TestInstancesWithCinderVolumes-1870135206 None] attachment_update completed successfully. Sep 17 07:30:39 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a" returned: 0 in 0.497s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:39 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a Sep 17 07:30:39 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:39 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-6bf681c0-1611-4f17-8f23-b4cc6d852c7a" returned: 0 in 0.442s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "cinder-quobyte-6bf681c0-1611-4f17-8f23-b4cc6d852c7a" released by "delete_volume" :: held 1.072s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:39 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Created reservations ['60f40f68-f085-4371-b843-38615c0902bb', 'faaf32a8-6757-41d7-9079-365b4dfc8d40', '02271e76-559f-4a81-b5eb-5da3aeb2fdaa', 'dce0caac-f5f4-4db2-9445-a94e46f8f54f'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:30:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:30:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:30:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:30:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:30:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:30:40 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:30:40 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:30:40 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Sep 17 07:30:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.264s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:30:40 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:30:40 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Deleted volume successfully. Sep 17 07:30:40 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-07fe4c0d-6b86-4792-8898-b53b69de0a19 tempest-VolumesSnapshotNegativeTestJSON-1343370393 None] Lock "cinder-6bf681c0-1611-4f17-8f23-b4cc6d852c7a-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:30:50 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=123,cinder:UPDATE=131,cinder:DELETE=7,cinder:INSERT=34 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:30:50 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=111,cinder:UPDATE=120,cinder:INSERT=39,cinder:DELETE=14 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:31:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:31:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:31:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:31:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:04 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:31:04 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:05 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.357s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:31:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:31:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:31:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Flow 'volume_create_manager' (98323c74-18ff-43ca-8971-60f4b483c925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37848627-b52b-4fac-8778-c74fdb251c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37848627-b52b-4fac-8778-c74fdb251c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-780130090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702ae8ae-184d-4611-b766-3cea17065636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dc0933a85e417994ec3a8e63a94917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:31:14Z,use_quota=True,user_id='55718e2ca2ba40fca07cff009a6d8d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a365ece-d0a8-414c-b77b-18b507540f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a365ece-d0a8-414c-b77b-18b507540f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da01a5f-d951-4c96-b47e-d121cedf87af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da01a5f-d951-4c96-b47e-d121cedf87af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '702ae8ae-184d-4611-b766-3cea17065636', 'volume_name': 'volume-702ae8ae-184d-4611-b766-3cea17065636', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3894cb-38a9-4e70-8755-552836c31793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3894cb-38a9-4e70-8755-552836c31793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73747fcc-cffe-4434-890b-4775cb0b3c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:14 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Volume 702ae8ae-184d-4611-b766-3cea17065636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-702ae8ae-184d-4611-b766-3cea17065636', 'volume_size': 1} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-780130090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702ae8ae-184d-4611-b766-3cea17065636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dc0933a85e417994ec3a8e63a94917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:31:14Z,use_quota=True,user_id='55718e2ca2ba40fca07cff009a6d8d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Creating volume 702ae8ae-184d-4611-b766-3cea17065636 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:31:14 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-702ae8ae-184d-4611-b766-3cea17065636 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:14 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-702ae8ae-184d-4611-b766-3cea17065636 1073741824 Sep 17 07:31:14 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Flow 'volume_create_manager' (d92965f0-a0bf-44fa-82a0-f84c25011f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41c74e5-5c9a-49ea-a59e-52e5be4ecc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41c74e5-5c9a-49ea-a59e-52e5be4ecc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1654199310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87958a48-4b35-4f60-ac14-4c3575e75dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dc0933a85e417994ec3a8e63a94917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:31:15Z,use_quota=True,user_id='55718e2ca2ba40fca07cff009a6d8d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207e8eca-9010-407a-b607-a9eac631991f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207e8eca-9010-407a-b607-a9eac631991f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22072431-84ab-4319-925f-23255fc420a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22072431-84ab-4319-925f-23255fc420a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87958a48-4b35-4f60-ac14-4c3575e75dc9', 'volume_name': 'volume-87958a48-4b35-4f60-ac14-4c3575e75dc9', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3039b7d4-7cf4-4bf2-b9fa-435c87d0c87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3039b7d4-7cf4-4bf2-b9fa-435c87d0c87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b950510-a4ce-4f10-a2a6-542a69c47b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:14 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Volume 87958a48-4b35-4f60-ac14-4c3575e75dc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87958a48-4b35-4f60-ac14-4c3575e75dc9', 'volume_size': 1} Sep 17 07:31:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:15 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-702ae8ae-184d-4611-b766-3cea17065636 1073741824" returned: 0 in 0.799s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-702ae8ae-184d-4611-b766-3cea17065636 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:15 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-702ae8ae-184d-4611-b766-3cea17065636 Sep 17 07:31:15 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:15 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-702ae8ae-184d-4611-b766-3cea17065636" returned: 0 in 0.350s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1654199310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87958a48-4b35-4f60-ac14-4c3575e75dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dc0933a85e417994ec3a8e63a94917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:31:15Z,use_quota=True,user_id='55718e2ca2ba40fca07cff009a6d8d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Creating volume 87958a48-4b35-4f60-ac14-4c3575e75dc9 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:31:15 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87958a48-4b35-4f60-ac14-4c3575e75dc9 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:15 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87958a48-4b35-4f60-ac14-4c3575e75dc9 1073741824 Sep 17 07:31:15 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73747fcc-cffe-4434-890b-4775cb0b3c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-702ae8ae-184d-4611-b766-3cea17065636', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97589717-5db4-49b0-9c64-45414955df48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:15 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Volume volume-702ae8ae-184d-4611-b766-3cea17065636 (702ae8ae-184d-4611-b766-3cea17065636): created successfully Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97589717-5db4-49b0-9c64-45414955df48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Flow 'volume_create_manager' (98323c74-18ff-43ca-8971-60f4b483c925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:31:15 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cb34b4a6-2803-407a-ad24-64280ed2fd64 tempest-TestServerVolumeAttachmentScenario-126113996 None] Created volume successfully. Sep 17 07:31:16 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87958a48-4b35-4f60-ac14-4c3575e75dc9 1073741824" returned: 0 in 0.713s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87958a48-4b35-4f60-ac14-4c3575e75dc9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:16 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87958a48-4b35-4f60-ac14-4c3575e75dc9 Sep 17 07:31:16 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:16 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87958a48-4b35-4f60-ac14-4c3575e75dc9" returned: 0 in 0.374s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:31:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b950510-a4ce-4f10-a2a6-542a69c47b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87958a48-4b35-4f60-ac14-4c3575e75dc9', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083c0073-4089-4ff6-ad40-01e9fcd4ebcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:16 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Volume volume-87958a48-4b35-4f60-ac14-4c3575e75dc9 (87958a48-4b35-4f60-ac14-4c3575e75dc9): created successfully Sep 17 07:31:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083c0073-4089-4ff6-ad40-01e9fcd4ebcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Flow 'volume_create_manager' (d92965f0-a0bf-44fa-82a0-f84c25011f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:31:16 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2b580690-6f40-40d9-9ddf-5ebb1e4f8a30 tempest-TestServerVolumeAttachmentScenario-126113996 None] Created volume successfully. Sep 17 07:31:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-44bedd4b-4a25-4af7-b816-63c036cfed4a req-2cbf2917-ea0a-4fbb-8fa6-552d256c4a46 tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-44bedd4b-4a25-4af7-b816-63c036cfed4a req-2cbf2917-ea0a-4fbb-8fa6-552d256c4a46 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-44bedd4b-4a25-4af7-b816-63c036cfed4a req-2cbf2917-ea0a-4fbb-8fa6-552d256c4a46 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-44bedd4b-4a25-4af7-b816-63c036cfed4a req-2cbf2917-ea0a-4fbb-8fa6-552d256c4a46 tempest-TestInstancesWithCinderVolumes-1870135206 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-30078b58-347d-46a9-992b-024b2d4785ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26ec163b-10da-44c6-8719-01759f2bae73', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:31:17 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-44bedd4b-4a25-4af7-b816-63c036cfed4a req-2cbf2917-ea0a-4fbb-8fa6-552d256c4a46 tempest-TestInstancesWithCinderVolumes-1870135206 None] attachment_update completed successfully. Sep 17 07:31:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-f2acd926-426e-445c-b910-2e5267ddb674 req-c9b04f6d-bd66-4488-8d1c-13f6095e3b99 tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-f2acd926-426e-445c-b910-2e5267ddb674 req-c9b04f6d-bd66-4488-8d1c-13f6095e3b99 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-f2acd926-426e-445c-b910-2e5267ddb674 req-c9b04f6d-bd66-4488-8d1c-13f6095e3b99 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-f2acd926-426e-445c-b910-2e5267ddb674 req-c9b04f6d-bd66-4488-8d1c-13f6095e3b99 tempest-TestInstancesWithCinderVolumes-1870135206 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0526855-a876-4d66-a53d-2d3d3775a218', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:31:20 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-f2acd926-426e-445c-b910-2e5267ddb674 req-c9b04f6d-bd66-4488-8d1c-13f6095e3b99 tempest-TestInstancesWithCinderVolumes-1870135206 None] attachment_update completed successfully. Sep 17 07:31:22 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:31:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Flow 'volume_create_manager' (2c5a4706-20fd-418b-a7bc-d390031760b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:31:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4664863f-f3e7-4f42-9055-1c703a0c861a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4664863f-f3e7-4f42-9055-1c703a0c861a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-603367275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3256e838-e7cd-4819-993c-4b6e246e1927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d5668ca5c0418e892ce2714d7c1723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:31:22Z,use_quota=True,user_id='82fe7d94a1da431eb248445f0fe14be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d71c94-7f35-46f8-87d1-56ee4d212c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d71c94-7f35-46f8-87d1-56ee4d212c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5cddcf-bf51-4cda-aabb-a605863f6cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:22 devstack cinder-volume[86029]: DEBUG cinder.image.glance [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Creating Keystone auth plugin from conf {{(pid=86029) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 07:31:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5cddcf-bf51-4cda-aabb-a605863f6cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3256e838-e7cd-4819-993c-4b6e246e1927', 'volume_name': 'volume-3256e838-e7cd-4819-993c-4b6e246e1927', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727bc4f5-a1d5-4057-9ecf-cd1e40d471cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727bc4f5-a1d5-4057-9ecf-cd1e40d471cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0297498b-a8c3-4c9b-8c4e-d76077c60435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:22 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Volume 3256e838-e7cd-4819-993c-4b6e246e1927: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3256e838-e7cd-4819-993c-4b6e246e1927', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 07:31:22 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Trying to clone 3256e838-e7cd-4819-993c-4b6e246e1927 from image d174ccf1-c953-4210-b592-ccde541c6f06 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]). {{(pid=86029) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 07:31:23 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_1iywky35devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 07:31:23 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Image download 20.69 MB at 20.69 MB/s Sep 17 07:31:23 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ad0338-0cd5-4940-8751-3fd36b293576]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:31:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_1iywky35devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:23 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_1iywky35devstack@QuobyteHD Sep 17 07:31:23 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:24 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_1iywky35devstack@QuobyteHD" returned: 0 in 0.601s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Temporary image d174ccf1-c953-4210-b592-ccde541c6f06 is fetched for user 82fe7d94a1da431eb248445f0fe14be4. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17b2181-877d-47ba-9eb2-b2f44556ec64]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_1iywky35devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:24 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_1iywky35devstack@QuobyteHD Sep 17 07:31:24 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:24 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_1iywky35devstack@QuobyteHD" returned: 0 in 0.568s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-603367275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3256e838-e7cd-4819-993c-4b6e246e1927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d5668ca5c0418e892ce2714d7c1723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:31:22Z,use_quota=True,user_id='82fe7d94a1da431eb248445f0fe14be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Creating volume 3256e838-e7cd-4819-993c-4b6e246e1927 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:31:24 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:31:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:24 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 1073741824 Sep 17 07:31:24 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:25 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 1073741824" returned: 0 in 0.665s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:25 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 Sep 17 07:31:25 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:25 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927" returned: 0 in 0.310s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:31:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:25 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Attempting download of d174ccf1-c953-4210-b592-ccde541c6f06 ((None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}])) to volume 3256e838-e7cd-4819-993c-4b6e246e1927. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 07:31:25 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd99fa41-15d5-4a92-967d-b96edc0afe16]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:31:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_0cpsmpoe {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:26 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_0cpsmpoe Sep 17 07:31:26 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:26 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_0cpsmpoe" returned: 0 in 0.347s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_0cpsmpoe {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:26 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_0cpsmpoe Sep 17 07:31:26 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:26 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_0cpsmpoe" returned: 1 in 0.345s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d174ccf1-c953-4210-b592-ccde541c6f06_0cpsmpoe' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:31:26 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0fe626-134c-4784-9b0f-f2973adb6e11]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:31:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_1iywky35devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:26 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_1iywky35devstack@QuobyteHD Sep 17 07:31:26 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:27 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_1iywky35devstack@QuobyteHD" returned: 0 in 0.498s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:27 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] d174ccf1-c953-4210-b592-ccde541c6f06 was qcow2, converting to qcow2 {{(pid=86029) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 07:31:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_1iywky35devstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:27 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_1iywky35devstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 Sep 17 07:31:27 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:27 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-7beb8a04-f33d-486c-b2f0-2eae4027cafb req-bc3bc6d3-1d5d-4517-8fbd-21fc3067c7ec tempest-TestInstancesWithCinderVolumes-1870135206 None] Terminate volume connection completed successfully. Sep 17 07:31:27 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-7beb8a04-f33d-486c-b2f0-2eae4027cafb req-bc3bc6d3-1d5d-4517-8fbd-21fc3067c7ec tempest-TestInstancesWithCinderVolumes-1870135206 None] Deleting attachment 26ec163b-10da-44c6-8719-01759f2bae73. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:31:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "cinder-30078b58-347d-46a9-992b-024b2d4785ec-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:31:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "cinder-30078b58-347d-46a9-992b-024b2d4785ec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:31:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "cinder-quobyte-30078b58-347d-46a9-992b-024b2d4785ec" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:31:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "cinder-quobyte-30078b58-347d-46a9-992b-024b2d4785ec" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:31:28 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48fda48-8a2e-4eef-8371-1ce5073a27fb]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:31:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-30078b58-347d-46a9-992b-024b2d4785ec {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:28 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-30078b58-347d-46a9-992b-024b2d4785ec Sep 17 07:31:28 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:28 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-30078b58-347d-46a9-992b-024b2d4785ec" returned: 0 in 0.514s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-30078b58-347d-46a9-992b-024b2d4785ec {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:28 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-30078b58-347d-46a9-992b-024b2d4785ec Sep 17 07:31:28 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:29 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-30078b58-347d-46a9-992b-024b2d4785ec" returned: 0 in 0.391s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "cinder-quobyte-30078b58-347d-46a9-992b-024b2d4785ec" released by "delete_volume" :: held 1.005s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:31:29 devstack cinder-volume[86029]: WARNING cinder.quota [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1573601332-1833756822 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1573601332-1833756822, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:31:29 devstack cinder-volume[86029]: WARNING cinder.quota [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1573601332-1833756822 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1573601332-1833756822, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:31:29 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Created reservations ['685f9c92-3f09-4e65-99ab-db359c9f307a', 'f98ff6c8-e1dc-4571-aed3-5bc178ff940f', '56f29c82-b8d0-4554-a3c7-198178f7f315', '0acc1bf6-0784-4513-a039-5dff51ae857f'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:31:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:31:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:31:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:29 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:31:29 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:29 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_1iywky35devstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927" returned: 0 in 2.673s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:29 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d174ccf1-c953-4210-b592-ccde541c6f06_1iywky35devstack@QuobyteHD, size 112.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:31:29 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Converted 112.00 MB image at 41.86 MB/s Sep 17 07:31:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:29 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 1G Sep 17 07:31:29 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:29 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.323s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:29 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:31:29 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Deleted volume successfully. Sep 17 07:31:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-faf59867-7674-4bc2-99ac-b3dbf184204a tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "cinder-30078b58-347d-46a9-992b-024b2d4785ec-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:31:30 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 1G" returned: 0 in 0.390s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:30 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Downloaded image d174ccf1-c953-4210-b592-ccde541c6f06 ((None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}])) to volume 3256e838-e7cd-4819-993c-4b6e246e1927 successfully. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 07:31:30 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Temporary image d174ccf1-c953-4210-b592-ccde541c6f06 for user 82fe7d94a1da431eb248445f0fe14be4 is deleted. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 07:31:30 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Marking volume 3256e838-e7cd-4819-993c-4b6e246e1927 as bootable. {{(pid=86029) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 07:31:30 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Copying metadata from image d174ccf1-c953-4210-b592-ccde541c6f06 to 3256e838-e7cd-4819-993c-4b6e246e1927. {{(pid=86029) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 07:31:30 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Creating volume glance metadata for volume 3256e838-e7cd-4819-993c-4b6e246e1927 backed by image d174ccf1-c953-4210-b592-ccde541c6f06 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86029) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 07:31:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0297498b-a8c3-4c9b-8c4e-d76077c60435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3256e838-e7cd-4819-993c-4b6e246e1927', 'volume_size': 1, 'image_id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d174ccf1-c953-4210-b592-ccde541c6f06', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72102fd6be13493992ec73584e9c4597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd174ccf1-c953-4210-b592-ccde541c6f06', 'created_at': datetime.datetime(2026, 9, 17, 5, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 11, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d174ccf1-c953-4210-b592-ccde541c6f06/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7ef945-bfaa-4c40-ac50-cc6dd2513704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:31:30 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Volume volume-3256e838-e7cd-4819-993c-4b6e246e1927 (3256e838-e7cd-4819-993c-4b6e246e1927): created successfully Sep 17 07:31:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7ef945-bfaa-4c40-ac50-cc6dd2513704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:31:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Flow 'volume_create_manager' (2c5a4706-20fd-418b-a7bc-d390031760b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:31:30 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b6c2fef3-6e8f-40fe-b014-1713dead18ab tempest-TestShelveInstance-1349943930 None] Created volume successfully. Sep 17 07:31:32 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-6ed4cf3f-761b-4e9c-b2c3-fb86e57a9dc6 req-f290c2db-ad00-46a9-b2fb-80bbd9403be8 tempest-TestInstancesWithCinderVolumes-1870135206 None] Terminate volume connection completed successfully. Sep 17 07:31:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-6ed4cf3f-761b-4e9c-b2c3-fb86e57a9dc6 req-f290c2db-ad00-46a9-b2fb-80bbd9403be8 tempest-TestInstancesWithCinderVolumes-1870135206 None] Deleting attachment c0526855-a876-4d66-a53d-2d3d3775a218. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:31:33 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "cinder-5fe072b3-41c7-446e-8350-8f5c7b9686b7-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:31:33 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "cinder-5fe072b3-41c7-446e-8350-8f5c7b9686b7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:31:33 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "cinder-quobyte-5fe072b3-41c7-446e-8350-8f5c7b9686b7" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:31:33 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "cinder-quobyte-5fe072b3-41c7-446e-8350-8f5c7b9686b7" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:31:33 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3563104e-8839-4d12-ba27-46e454677307]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:31:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:33 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7 Sep 17 07:31:33 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-37fbac7b-bc21-4878-b833-bec138ba4082 req-475233ad-40f3-429b-8e86-7d28a6f9cef0 tempest-TestShelveInstance-1349943930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-37fbac7b-bc21-4878-b833-bec138ba4082 req-475233ad-40f3-429b-8e86-7d28a6f9cef0 tempest-TestShelveInstance-1349943930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-37fbac7b-bc21-4878-b833-bec138ba4082 req-475233ad-40f3-429b-8e86-7d28a6f9cef0 tempest-TestShelveInstance-1349943930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-37fbac7b-bc21-4878-b833-bec138ba4082 req-475233ad-40f3-429b-8e86-7d28a6f9cef0 tempest-TestShelveInstance-1349943930 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-3256e838-e7cd-4819-993c-4b6e246e1927', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '055d1f1e-1dd6-4b3b-8c9d-f6f31052b4a3', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:31:34 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-37fbac7b-bc21-4878-b833-bec138ba4082 req-475233ad-40f3-429b-8e86-7d28a6f9cef0 tempest-TestShelveInstance-1349943930 None] attachment_update completed successfully. Sep 17 07:31:34 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7" returned: 0 in 0.554s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:34 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7 Sep 17 07:31:34 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:34 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5fe072b3-41c7-446e-8350-8f5c7b9686b7" returned: 0 in 0.504s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "cinder-quobyte-5fe072b3-41c7-446e-8350-8f5c7b9686b7" released by "delete_volume" :: held 1.164s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:31:35 devstack cinder-volume[86029]: WARNING cinder.quota [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-395715574-1601532951 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-395715574-1601532951, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:31:35 devstack cinder-volume[86029]: WARNING cinder.quota [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-395715574-1601532951 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-395715574-1601532951, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:31:35 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Created reservations ['efb18b38-e37d-40fd-b888-3de9392a75b2', '48740103-76c2-4782-9b05-2172e562dc07', '5c6e6037-b3eb-4733-ae71-706177c6adff', '76d8cba8-652c-4740-ba2c-f16be152ea58'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:31:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:31:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:31:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:35 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:31:35 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:35 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.355s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:35 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:31:35 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Deleted volume successfully. Sep 17 07:31:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41eed4e4-51d5-4b46-8553-bf4c53692968 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "cinder-5fe072b3-41c7-446e-8350-8f5c7b9686b7-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:31:39 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-37fbac7b-bc21-4878-b833-bec138ba4082 req-a5732e42-926e-4ccc-8353-17585152e7fc tempest-TestShelveInstance-1349943930 None] Terminate volume connection completed successfully. Sep 17 07:31:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-37fbac7b-bc21-4878-b833-bec138ba4082 req-a5732e42-926e-4ccc-8353-17585152e7fc tempest-TestShelveInstance-1349943930 None] Deleting attachment 055d1f1e-1dd6-4b3b-8c9d-f6f31052b4a3. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:31:39 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-a9a9e62a-bfd4-490b-9c4c-b78d3e145eac req-435d813b-d1ee-47ff-a21b-d56d1c9a018e tempest-TestInstancesWithCinderVolumes-1870135206 None] Terminate volume connection completed successfully. Sep 17 07:31:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-a9a9e62a-bfd4-490b-9c4c-b78d3e145eac req-435d813b-d1ee-47ff-a21b-d56d1c9a018e tempest-TestInstancesWithCinderVolumes-1870135206 None] Deleting attachment 89cd87ff-a46a-4dc8-9f41-85589190ceb2. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "cinder-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "cinder-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "cinder-quobyte-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "cinder-quobyte-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[25734253-a2f5-409f-8cce-2b1a5a8c9b60]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:41 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d Sep 17 07:31:41 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:41 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d" returned: 0 in 0.357s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:41 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d Sep 17 07:31:41 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:41 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d" returned: 0 in 0.325s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "cinder-quobyte-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d" released by "delete_volume" :: held 0.724s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:31:41 devstack cinder-volume[86029]: WARNING cinder.quota [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-795980623-1386260691 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-795980623-1386260691, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:31:41 devstack cinder-volume[86029]: WARNING cinder.quota [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-795980623-1386260691 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-795980623-1386260691, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Created reservations ['175919a2-093b-488a-82d1-3b583990b3ed', '5ec2bbd5-12a4-4453-9a10-7046f430cf2f', '0b332fe1-f52d-40ca-b3cb-52f7860e2f31', 'b6583995-2864-4028-bd81-2b817f96a040'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:41 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:31:41 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:42 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.247s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:42 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:31:42 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Deleted volume successfully. Sep 17 07:31:42 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-245bc2c7-5558-44aa-842e-1b697674e670 tempest-TestInstancesWithCinderVolumes-1870135206 None] Lock "cinder-9bf16fb2-13f5-4651-8dbb-d9a23bc24b4d-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:31:43 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Acquiring lock "cinder-3256e838-e7cd-4819-993c-4b6e246e1927-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:31:43 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Lock "cinder-3256e838-e7cd-4819-993c-4b6e246e1927-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:31:43 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Acquiring lock "cinder-quobyte-3256e838-e7cd-4819-993c-4b6e246e1927" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:31:43 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Lock "cinder-quobyte-3256e838-e7cd-4819-993c-4b6e246e1927" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:31:43 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e684255-f209-4f6b-8a03-ca958494804c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:31:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:43 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 Sep 17 07:31:43 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:43 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927" returned: 0 in 0.467s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:43 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927 Sep 17 07:31:43 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:44 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-3256e838-e7cd-4819-993c-4b6e246e1927" returned: 0 in 0.257s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Lock "cinder-quobyte-3256e838-e7cd-4819-993c-4b6e246e1927" released by "delete_volume" :: held 0.780s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:31:44 devstack cinder-volume[86029]: DEBUG cinder.quota [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Created reservations ['c05de117-3152-4e85-860a-2cfa8cffa39c', '834e9cae-1828-413a-bce9-878399926f07', '500a5894-515a-4b5e-856b-1ae1b6363165', 'fe8fbd29-60bc-4f3b-b97f-ebc15a4c32be'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:31:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:31:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:31:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:31:44 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:31:44 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:31:44 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Sep 17 07:31:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.304s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:31:44 devstack cinder-volume[86029]: DEBUG cinder.manager [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:31:44 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Deleted volume successfully. Sep 17 07:31:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [req-7a498eb6-9d37-4ea5-8148-97845178c8b9 req-9a03d3bd-185c-44e9-be2d-7e89f6a3cc6a tempest-TestShelveInstance-1349943930 None] Lock "cinder-3256e838-e7cd-4819-993c-4b6e246e1927-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:31:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-868b473f-6da8-451c-a5be-fd07bec5f086 req-5cf7059d-ff73-4a53-bfaa-c467ab6c6e58 tempest-TestServerVolumeAttachmentScenario-126113996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-868b473f-6da8-451c-a5be-fd07bec5f086 req-5cf7059d-ff73-4a53-bfaa-c467ab6c6e58 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-868b473f-6da8-451c-a5be-fd07bec5f086 req-5cf7059d-ff73-4a53-bfaa-c467ab6c6e58 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-868b473f-6da8-451c-a5be-fd07bec5f086 req-5cf7059d-ff73-4a53-bfaa-c467ab6c6e58 tempest-TestServerVolumeAttachmentScenario-126113996 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-702ae8ae-184d-4611-b766-3cea17065636', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca908666-b168-4ebe-8ca1-461598513199', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:31:51 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-868b473f-6da8-451c-a5be-fd07bec5f086 req-5cf7059d-ff73-4a53-bfaa-c467ab6c6e58 tempest-TestServerVolumeAttachmentScenario-126113996 None] attachment_update completed successfully. Sep 17 07:31:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-d45a6095-73e6-4ee7-9f3c-7a3a8e0f5d8e req-84fce545-3d5a-42b0-9b89-53e595d7798c tempest-TestServerVolumeAttachmentScenario-126113996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:31:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-d45a6095-73e6-4ee7-9f3c-7a3a8e0f5d8e req-84fce545-3d5a-42b0-9b89-53e595d7798c tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:31:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-d45a6095-73e6-4ee7-9f3c-7a3a8e0f5d8e req-84fce545-3d5a-42b0-9b89-53e595d7798c tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:31:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-d45a6095-73e6-4ee7-9f3c-7a3a8e0f5d8e req-84fce545-3d5a-42b0-9b89-53e595d7798c tempest-TestServerVolumeAttachmentScenario-126113996 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-87958a48-4b35-4f60-ac14-4c3575e75dc9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd7eb99d-8d9a-47c0-bc58-146aceb7168e', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:31:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-d45a6095-73e6-4ee7-9f3c-7a3a8e0f5d8e req-84fce545-3d5a-42b0-9b89-53e595d7798c tempest-TestServerVolumeAttachmentScenario-126113996 None] attachment_update completed successfully. Sep 17 07:32:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-21b52594-fb1b-4be9-bdb0-a902fdb926a2 req-78a15343-0b27-44d2-9cdc-d76f514a5f8d tempest-TestServerVolumeAttachmentScenario-126113996 None] Terminate volume connection completed successfully. Sep 17 07:32:00 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-21b52594-fb1b-4be9-bdb0-a902fdb926a2 req-78a15343-0b27-44d2-9cdc-d76f514a5f8d tempest-TestServerVolumeAttachmentScenario-126113996 None] Deleting attachment bd7eb99d-8d9a-47c0-bc58-146aceb7168e. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:32:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-5e4c69a4-637c-4d9a-aefa-fc631220e75e req-047d95d0-4fb3-441c-8427-9fe09b856e2c tempest-TestServerVolumeAttachmentScenario-126113996 None] Terminate volume connection completed successfully. Sep 17 07:32:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-5e4c69a4-637c-4d9a-aefa-fc631220e75e req-047d95d0-4fb3-441c-8427-9fe09b856e2c tempest-TestServerVolumeAttachmentScenario-126113996 None] Deleting attachment ca908666-b168-4ebe-8ca1-461598513199. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:32:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:32:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:04 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:32:04 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:05 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.372s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:32:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:32:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:32:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:32:10 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:UPDATE=46,cinder:SELECT=66,cinder:INSERT=21,cinder:DELETE=3 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:32:11 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=78,cinder:UPDATE=54,cinder:DELETE=4,cinder:INSERT=11 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:32:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Acquiring lock "cinder-87958a48-4b35-4f60-ac14-4c3575e75dc9-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:32:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "cinder-87958a48-4b35-4f60-ac14-4c3575e75dc9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:32:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Acquiring lock "cinder-quobyte-87958a48-4b35-4f60-ac14-4c3575e75dc9" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:32:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "cinder-quobyte-87958a48-4b35-4f60-ac14-4c3575e75dc9" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:32:16 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e782d32-82fc-47a0-a51e-b98448d34036]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:32:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87958a48-4b35-4f60-ac14-4c3575e75dc9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:16 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87958a48-4b35-4f60-ac14-4c3575e75dc9 Sep 17 07:32:16 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:16 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87958a48-4b35-4f60-ac14-4c3575e75dc9" returned: 0 in 0.398s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87958a48-4b35-4f60-ac14-4c3575e75dc9 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:17 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87958a48-4b35-4f60-ac14-4c3575e75dc9 Sep 17 07:32:17 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:17 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87958a48-4b35-4f60-ac14-4c3575e75dc9" returned: 0 in 0.306s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "cinder-quobyte-87958a48-4b35-4f60-ac14-4c3575e75dc9" released by "delete_volume" :: held 0.778s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Created reservations ['4149f8d7-3a0f-4824-aaad-829f9d480e75', 'd98bb077-5c0a-4520-a623-4e3f33287be8', 'e2fa100e-45ec-47b3-a807-9a9381590f30', '3d8bf182-c132-4420-ba88-3f587adddc17'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:17 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:32:17 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Acquiring lock "cinder-702ae8ae-184d-4611-b766-3cea17065636-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "cinder-702ae8ae-184d-4611-b766-3cea17065636-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Acquiring lock "cinder-quobyte-702ae8ae-184d-4611-b766-3cea17065636" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "cinder-quobyte-702ae8ae-184d-4611-b766-3cea17065636" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:32:17 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.358s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:32:17 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Deleted volume successfully. Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d0a155-0713-427e-9c97-a36285c514e3]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-702ae8ae-184d-4611-b766-3cea17065636 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-27671bc8-7e8b-4260-a7aa-57c1511e8243 tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "cinder-87958a48-4b35-4f60-ac14-4c3575e75dc9-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:32:17 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-702ae8ae-184d-4611-b766-3cea17065636 Sep 17 07:32:17 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:18 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-702ae8ae-184d-4611-b766-3cea17065636" returned: 0 in 0.448s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-702ae8ae-184d-4611-b766-3cea17065636 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:18 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-702ae8ae-184d-4611-b766-3cea17065636 Sep 17 07:32:18 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:18 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-702ae8ae-184d-4611-b766-3cea17065636" returned: 0 in 0.303s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "cinder-quobyte-702ae8ae-184d-4611-b766-3cea17065636" released by "delete_volume" :: held 0.846s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:32:18 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Created reservations ['08c62c85-94b3-464f-907c-83e7dfeaeb2b', '8c122854-923e-4d33-a384-7f9953778241', '1ed90a5f-2939-4bb2-b7b9-db69463a6399', '71e86dca-5b9d-4d21-a05c-67a09d07ddf0'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:32:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:18 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:32:18 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:19 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.313s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:19 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:32:19 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Deleted volume successfully. Sep 17 07:32:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4bc2e8f6-b1c5-49a5-b14d-885c8887d77e tempest-TestServerVolumeAttachmentScenario-126113996 None] Lock "cinder-702ae8ae-184d-4611-b766-3cea17065636-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:32:28 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=11,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Flow 'volume_create_manager' (35028ba8-b1eb-46c5-aa71-f64a51033d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f543d65-7c05-4b5e-8da2-c09ab21984d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f543d65-7c05-4b5e-8da2-c09ab21984d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-481778371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a537fe-f2ca-456f-ace1-221e24aec9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cf3308e4904df7841a509312652c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:31Z,use_quota=True,user_id='134e561cb6c340489a170577999d450e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe8323d-75a0-46fe-998f-362864a55b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe8323d-75a0-46fe-998f-362864a55b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8980214-f515-49ec-a541-e91f31193560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8980214-f515-49ec-a541-e91f31193560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01a537fe-f2ca-456f-ace1-221e24aec9c7', 'volume_name': 'volume-01a537fe-f2ca-456f-ace1-221e24aec9c7', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b528e9-5f79-42a4-82a1-99b323302a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b528e9-5f79-42a4-82a1-99b323302a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ac4c17-a0b7-44e2-8208-c1bfeac71e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:30 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Volume 01a537fe-f2ca-456f-ace1-221e24aec9c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01a537fe-f2ca-456f-ace1-221e24aec9c7', 'volume_size': 1} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-481778371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a537fe-f2ca-456f-ace1-221e24aec9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cf3308e4904df7841a509312652c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:31Z,use_quota=True,user_id='134e561cb6c340489a170577999d450e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Creating volume 01a537fe-f2ca-456f-ace1-221e24aec9c7 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:32:30 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:32:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:30 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 1073741824 Sep 17 07:32:30 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:31 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 1073741824" returned: 0 in 0.553s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:31 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 Sep 17 07:32:31 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:31 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7" returned: 0 in 0.286s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:32:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ac4c17-a0b7-44e2-8208-c1bfeac71e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a537fe-f2ca-456f-ace1-221e24aec9c7', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4adb0d56-0b7a-4853-8f91-8ec4766e5b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:31 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Volume volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 (01a537fe-f2ca-456f-ace1-221e24aec9c7): created successfully Sep 17 07:32:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4adb0d56-0b7a-4853-8f91-8ec4766e5b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:31 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Flow 'volume_create_manager' (35028ba8-b1eb-46c5-aa71-f64a51033d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:31 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b7d3c71d-660a-496c-9d3b-18e5b87fd24a tempest-TestStampPattern-309290661 None] Created volume successfully. Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Flow 'volume_create_manager' (a48c4b07-586a-4819-bc8c-594903720974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9d807b-e17c-4a4f-9953-d0e79c51cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9d807b-e17c-4a4f-9953-d0e79c51cb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-465390826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc208ca-d79f-4fc7-ae35-7baf62269898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a18cb64493e46ee8dd6d2db8666b1fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:38Z,use_quota=True,user_id='bd3377020c41461e89a34a6313b1c646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1acd6e38-e4fb-46f3-a760-534d76dc78d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1acd6e38-e4fb-46f3-a760-534d76dc78d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93b8d73-29ca-4175-aa02-e652778ba720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93b8d73-29ca-4175-aa02-e652778ba720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abc208ca-d79f-4fc7-ae35-7baf62269898', 'volume_name': 'volume-abc208ca-d79f-4fc7-ae35-7baf62269898', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd2db89-e65d-4b44-92c8-5be7c0a71893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd2db89-e65d-4b44-92c8-5be7c0a71893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b393337d-a2a7-41dd-a3ad-27ba77269c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:38 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Volume abc208ca-d79f-4fc7-ae35-7baf62269898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abc208ca-d79f-4fc7-ae35-7baf62269898', 'volume_size': 1} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-465390826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc208ca-d79f-4fc7-ae35-7baf62269898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a18cb64493e46ee8dd6d2db8666b1fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:38Z,use_quota=True,user_id='bd3377020c41461e89a34a6313b1c646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Creating volume abc208ca-d79f-4fc7-ae35-7baf62269898 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:32:38 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:32:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-abc208ca-d79f-4fc7-ae35-7baf62269898 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:38 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-abc208ca-d79f-4fc7-ae35-7baf62269898 1073741824 Sep 17 07:32:38 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:39 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-abc208ca-d79f-4fc7-ae35-7baf62269898 1073741824" returned: 0 in 1.109s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-abc208ca-d79f-4fc7-ae35-7baf62269898 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:39 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-abc208ca-d79f-4fc7-ae35-7baf62269898 Sep 17 07:32:39 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:40 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-abc208ca-d79f-4fc7-ae35-7baf62269898" returned: 0 in 0.698s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:32:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b393337d-a2a7-41dd-a3ad-27ba77269c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abc208ca-d79f-4fc7-ae35-7baf62269898', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ca59ab-b04b-407f-8c64-b3255b08db45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:40 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Volume volume-abc208ca-d79f-4fc7-ae35-7baf62269898 (abc208ca-d79f-4fc7-ae35-7baf62269898): created successfully Sep 17 07:32:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ca59ab-b04b-407f-8c64-b3255b08db45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Flow 'volume_create_manager' (a48c4b07-586a-4819-bc8c-594903720974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:40 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4d1114e1-535a-4d2a-833d-0497bc06dc31 tempest-TestMinimumBasicScenario-1881341440 None] Created volume successfully. Sep 17 07:32:42 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:32:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Flow 'volume_create_manager' (7fd99ab6-31d8-4f7f-b279-8c076c68f0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c56261-59bf-41d2-8d1b-0ecc75850260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c56261-59bf-41d2-8d1b-0ecc75850260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-21216957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c941283e-a6f2-4e51-9e3e-3675ad8da82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8feca78e8afe441aaf9478fad0a5e6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:43Z,use_quota=True,user_id='0706d93f10954b3a88de7dda4aed830b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f29fd28-9b9d-43b7-b904-947de239733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f29fd28-9b9d-43b7-b904-947de239733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea20180-c12c-47fa-91f2-d1312025f7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea20180-c12c-47fa-91f2-d1312025f7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c941283e-a6f2-4e51-9e3e-3675ad8da82b', 'volume_name': 'volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a477f6-477c-474c-ac31-26f634cd1374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a477f6-477c-474c-ac31-26f634cd1374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4547ab-a6e3-45b9-8b86-9f8078384e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:42 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume c941283e-a6f2-4e51-9e3e-3675ad8da82b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b', 'volume_size': 1} Sep 17 07:32:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-21216957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c941283e-a6f2-4e51-9e3e-3675ad8da82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8feca78e8afe441aaf9478fad0a5e6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:43Z,use_quota=True,user_id='0706d93f10954b3a88de7dda4aed830b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:32:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Creating volume c941283e-a6f2-4e51-9e3e-3675ad8da82b {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:32:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:32:43 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:32:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:43 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b 1073741824 Sep 17 07:32:43 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-d655c74f-2b94-4a01-a599-f3f7adcd71a7 req-05567e38-4a8d-4595-b62f-2dceb156e616 tempest-TestMinimumBasicScenario-1881341440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:43 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b 1073741824" returned: 0 in 0.608s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:43 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b Sep 17 07:32:43 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:44 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b" returned: 0 in 0.375s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:32:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-d655c74f-2b94-4a01-a599-f3f7adcd71a7 req-05567e38-4a8d-4595-b62f-2dceb156e616 tempest-TestMinimumBasicScenario-1881341440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.931s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4547ab-a6e3-45b9-8b86-9f8078384e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdca81d-1a14-469c-ae8c-24ebf20a2b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-d655c74f-2b94-4a01-a599-f3f7adcd71a7 req-05567e38-4a8d-4595-b62f-2dceb156e616 tempest-TestMinimumBasicScenario-1881341440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.057s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:44 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b (c941283e-a6f2-4e51-9e3e-3675ad8da82b): created successfully Sep 17 07:32:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdca81d-1a14-469c-ae8c-24ebf20a2b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Flow 'volume_create_manager' (7fd99ab6-31d8-4f7f-b279-8c076c68f0dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:44 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-46462bcc-e38f-4a2b-9410-6a65f1015d63 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Created volume successfully. Sep 17 07:32:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-d655c74f-2b94-4a01-a599-f3f7adcd71a7 req-05567e38-4a8d-4595-b62f-2dceb156e616 tempest-TestMinimumBasicScenario-1881341440 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-abc208ca-d79f-4fc7-ae35-7baf62269898', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1147feaa-5d1a-4f17-ab28-6aeced97ff35', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:32:44 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-d655c74f-2b94-4a01-a599-f3f7adcd71a7 req-05567e38-4a8d-4595-b62f-2dceb156e616 tempest-TestMinimumBasicScenario-1881341440 None] attachment_update completed successfully. Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Flow 'volume_create_manager' (8b8c39f8-7a9e-4c5e-aeb2-acf02daac1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d365b1e-9429-45ab-97bb-95fca0be002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d365b1e-9429-45ab-97bb-95fca0be002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1808899923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482f9405-00de-463c-b147-9b6ef277cf73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8feca78e8afe441aaf9478fad0a5e6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:46Z,use_quota=True,user_id='0706d93f10954b3a88de7dda4aed830b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872808f7-e831-436d-85b0-110438721d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872808f7-e831-436d-85b0-110438721d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f8a4a1-fab8-4fca-ad7d-5e545ca89151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f8a4a1-fab8-4fca-ad7d-5e545ca89151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482f9405-00de-463c-b147-9b6ef277cf73', 'volume_name': 'volume-482f9405-00de-463c-b147-9b6ef277cf73', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19554a0a-f73e-49d3-9519-9aa419e593b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19554a0a-f73e-49d3-9519-9aa419e593b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b60bfa-7bd7-4360-bb93-d714f9a7b24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:45 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume 482f9405-00de-463c-b147-9b6ef277cf73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482f9405-00de-463c-b147-9b6ef277cf73', 'volume_size': 1} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1808899923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482f9405-00de-463c-b147-9b6ef277cf73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8feca78e8afe441aaf9478fad0a5e6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:46Z,use_quota=True,user_id='0706d93f10954b3a88de7dda4aed830b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Creating volume 482f9405-00de-463c-b147-9b6ef277cf73 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:32:45 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:32:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-482f9405-00de-463c-b147-9b6ef277cf73 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:46 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-482f9405-00de-463c-b147-9b6ef277cf73 1073741824 Sep 17 07:32:46 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:46 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:32:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Flow 'volume_create_manager' (ff1dce99-9a4f-47c1-b230-a9ce475e2766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dab059b-4c98-4cf3-89bd-a07843dc2db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dab059b-4c98-4cf3-89bd-a07843dc2db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1436243441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676d51a4-237b-4aa3-8e79-665fb364fbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8feca78e8afe441aaf9478fad0a5e6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:46Z,use_quota=True,user_id='0706d93f10954b3a88de7dda4aed830b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c81988-1353-4ea0-9c9e-4693dca70e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c81988-1353-4ea0-9c9e-4693dca70e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9f0a51-3766-4e2a-b3ed-e3933bbde0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9f0a51-3766-4e2a-b3ed-e3933bbde0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676d51a4-237b-4aa3-8e79-665fb364fbea', 'volume_name': 'volume-676d51a4-237b-4aa3-8e79-665fb364fbea', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652ab0cc-faf6-4323-9d2f-d86102807180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652ab0cc-faf6-4323-9d2f-d86102807180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:46 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a5ac2c-934a-4eec-a80a-ea28504df53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:46 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume 676d51a4-237b-4aa3-8e79-665fb364fbea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676d51a4-237b-4aa3-8e79-665fb364fbea', 'volume_size': 1} Sep 17 07:32:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:47 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-482f9405-00de-463c-b147-9b6ef277cf73 1073741824" returned: 0 in 1.063s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-482f9405-00de-463c-b147-9b6ef277cf73 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:47 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-482f9405-00de-463c-b147-9b6ef277cf73 Sep 17 07:32:47 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:32:47 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Flow 'volume_create_manager' (9472e9c8-e546-4284-bdd2-4574eb291c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8bae85-54d3-49f7-807b-bfadb69bf57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-482f9405-00de-463c-b147-9b6ef277cf73" returned: 0 in 0.766s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.150s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1436243441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676d51a4-237b-4aa3-8e79-665fb364fbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8feca78e8afe441aaf9478fad0a5e6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:46Z,use_quota=True,user_id='0706d93f10954b3a88de7dda4aed830b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Creating volume 676d51a4-237b-4aa3-8e79-665fb364fbea {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:32:47 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:32:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-676d51a4-237b-4aa3-8e79-665fb364fbea 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8bae85-54d3-49f7-807b-bfadb69bf57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-201383188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1387844-697a-4767-93ac-cf2f8b3f7584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8feca78e8afe441aaf9478fad0a5e6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:48Z,use_quota=True,user_id='0706d93f10954b3a88de7dda4aed830b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:48 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-676d51a4-237b-4aa3-8e79-665fb364fbea 1073741824 Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc83963e-9e03-4401-ba0a-a80a146bf9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:48 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc83963e-9e03-4401-ba0a-a80a146bf9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053f1d01-34cc-402a-a281-52ac3133b523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053f1d01-34cc-402a-a281-52ac3133b523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1387844-697a-4767-93ac-cf2f8b3f7584', 'volume_name': 'volume-d1387844-697a-4767-93ac-cf2f8b3f7584', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2250ac-4297-42c3-bd62-0217bb54c606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2250ac-4297-42c3-bd62-0217bb54c606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f71cd2-9442-4799-8b1a-220674b1b9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:48 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume d1387844-697a-4767-93ac-cf2f8b3f7584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1387844-697a-4767-93ac-cf2f8b3f7584', 'volume_size': 1} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b60bfa-7bd7-4360-bb93-d714f9a7b24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482f9405-00de-463c-b147-9b6ef277cf73', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92523817-1d88-4527-9b64-494e8b818370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:48 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume volume-482f9405-00de-463c-b147-9b6ef277cf73 (482f9405-00de-463c-b147-9b6ef277cf73): created successfully Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92523817-1d88-4527-9b64-494e8b818370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Flow 'volume_create_manager' (8b8c39f8-7a9e-4c5e-aeb2-acf02daac1b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:48 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a9cb3418-93d6-4b61-9113-9b1e28886c72 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Created volume successfully. Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Flow 'volume_create_manager' (b23f9393-1762-4af6-9cff-e39321734aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1151a027-ca80-4e13-af60-74c9f00e8166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1151a027-ca80-4e13-af60-74c9f00e8166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-650905791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81724a6d-22fa-4c2d-8793-c440b98716d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8feca78e8afe441aaf9478fad0a5e6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:48Z,use_quota=True,user_id='0706d93f10954b3a88de7dda4aed830b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42ad685-052e-473b-9fcc-3ad0fac40864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42ad685-052e-473b-9fcc-3ad0fac40864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71775dc5-5717-4a08-838f-923f7cf837ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71775dc5-5717-4a08-838f-923f7cf837ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81724a6d-22fa-4c2d-8793-c440b98716d7', 'volume_name': 'volume-81724a6d-22fa-4c2d-8793-c440b98716d7', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4fc8ff-c972-4e99-8e18-331a6f3237ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4fc8ff-c972-4e99-8e18-331a6f3237ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42f195e-b273-45d5-831d-474cfa869410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:48 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume 81724a6d-22fa-4c2d-8793-c440b98716d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81724a6d-22fa-4c2d-8793-c440b98716d7', 'volume_size': 1} Sep 17 07:32:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:49 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-676d51a4-237b-4aa3-8e79-665fb364fbea 1073741824" returned: 0 in 1.371s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-676d51a4-237b-4aa3-8e79-665fb364fbea {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:49 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-676d51a4-237b-4aa3-8e79-665fb364fbea Sep 17 07:32:49 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Flow 'volume_create_manager' (679eeb36-6df8-4140-9b5f-10a2a36d5d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f32c0d-d998-4af8-b83f-b3bf3949d719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f32c0d-d998-4af8-b83f-b3bf3949d719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1444302884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d387e7a4-ec9a-4ab9-a93e-9d8d3df37794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8feca78e8afe441aaf9478fad0a5e6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:49Z,use_quota=True,user_id='0706d93f10954b3a88de7dda4aed830b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74e251d-0575-4afd-86bc-506db24193f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74e251d-0575-4afd-86bc-506db24193f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2cf8d0f-f616-40eb-9129-125c1c240cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2cf8d0f-f616-40eb-9129-125c1c240cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd387e7a4-ec9a-4ab9-a93e-9d8d3df37794', 'volume_name': 'volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e3e3cd-08a7-4eee-929c-10a1ca9217f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e3e3cd-08a7-4eee-929c-10a1ca9217f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49b663d-c35d-4c65-9541-f9a68d5c9d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:49 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume d387e7a4-ec9a-4ab9-a93e-9d8d3df37794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794', 'volume_size': 1} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:49 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-676d51a4-237b-4aa3-8e79-665fb364fbea" returned: 0 in 0.476s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.747s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-201383188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1387844-697a-4767-93ac-cf2f8b3f7584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8feca78e8afe441aaf9478fad0a5e6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:48Z,use_quota=True,user_id='0706d93f10954b3a88de7dda4aed830b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Creating volume d1387844-697a-4767-93ac-cf2f8b3f7584 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:32:49 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1387844-697a-4767-93ac-cf2f8b3f7584 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:49 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1387844-697a-4767-93ac-cf2f8b3f7584 1073741824 Sep 17 07:32:49 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a5ac2c-934a-4eec-a80a-ea28504df53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676d51a4-237b-4aa3-8e79-665fb364fbea', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff78ed70-2a76-42c3-8fbb-69f0e68018ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:50 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume volume-676d51a4-237b-4aa3-8e79-665fb364fbea (676d51a4-237b-4aa3-8e79-665fb364fbea): created successfully Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff78ed70-2a76-42c3-8fbb-69f0e68018ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Flow 'volume_create_manager' (ff1dce99-9a4f-47c1-b230-a9ce475e2766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:50 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-f99f8ab7-ddf0-40f5-aa3e-8f10f5feeb56 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Created volume successfully. Sep 17 07:32:50 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1387844-697a-4767-93ac-cf2f8b3f7584 1073741824" returned: 0 in 0.521s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1387844-697a-4767-93ac-cf2f8b3f7584 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:50 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1387844-697a-4767-93ac-cf2f8b3f7584 Sep 17 07:32:50 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:50 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1387844-697a-4767-93ac-cf2f8b3f7584" returned: 0 in 0.260s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.853s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-650905791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81724a6d-22fa-4c2d-8793-c440b98716d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8feca78e8afe441aaf9478fad0a5e6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:48Z,use_quota=True,user_id='0706d93f10954b3a88de7dda4aed830b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Creating volume 81724a6d-22fa-4c2d-8793-c440b98716d7 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:32:50 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81724a6d-22fa-4c2d-8793-c440b98716d7 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:50 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81724a6d-22fa-4c2d-8793-c440b98716d7 1073741824 Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f71cd2-9442-4799-8b1a-220674b1b9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1387844-697a-4767-93ac-cf2f8b3f7584', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:50 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17a27f6-efda-4c78-ab37-5c94a0f2c7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:50 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume volume-d1387844-697a-4767-93ac-cf2f8b3f7584 (d1387844-697a-4767-93ac-cf2f8b3f7584): created successfully Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17a27f6-efda-4c78-ab37-5c94a0f2c7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Flow 'volume_create_manager' (9472e9c8-e546-4284-bdd2-4574eb291c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:50 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-dc3181f8-5402-4168-b9ce-dd68608807bf tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Created volume successfully. Sep 17 07:32:51 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81724a6d-22fa-4c2d-8793-c440b98716d7 1073741824" returned: 0 in 0.618s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81724a6d-22fa-4c2d-8793-c440b98716d7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:51 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81724a6d-22fa-4c2d-8793-c440b98716d7 Sep 17 07:32:51 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:51 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81724a6d-22fa-4c2d-8793-c440b98716d7" returned: 0 in 0.483s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.215s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1444302884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d387e7a4-ec9a-4ab9-a93e-9d8d3df37794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8feca78e8afe441aaf9478fad0a5e6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:32:49Z,use_quota=True,user_id='0706d93f10954b3a88de7dda4aed830b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Creating volume d387e7a4-ec9a-4ab9-a93e-9d8d3df37794 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:32:51 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:32:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:52 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794 1073741824 Sep 17 07:32:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42f195e-b273-45d5-831d-474cfa869410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81724a6d-22fa-4c2d-8793-c440b98716d7', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:52 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c15fbf-fb73-41d5-a9ba-09fbaa279b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:52 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume volume-81724a6d-22fa-4c2d-8793-c440b98716d7 (81724a6d-22fa-4c2d-8793-c440b98716d7): created successfully Sep 17 07:32:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c15fbf-fb73-41d5-a9ba-09fbaa279b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Flow 'volume_create_manager' (b23f9393-1762-4af6-9cff-e39321734aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:52 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-5fdefbe8-785a-42ef-ba1b-41ecc3a3849d tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Created volume successfully. Sep 17 07:32:52 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794 1073741824" returned: 0 in 0.597s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:52 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794 Sep 17 07:32:52 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:52 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794" returned: 0 in 0.293s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:32:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49b663d-c35d-4c65-9541-f9a68d5c9d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f36a65-dcd6-480e-bf78-91d59762e4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:32:52 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Volume volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794 (d387e7a4-ec9a-4ab9-a93e-9d8d3df37794): created successfully Sep 17 07:32:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f36a65-dcd6-480e-bf78-91d59762e4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:32:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Flow 'volume_create_manager' (679eeb36-6df8-4140-9b5f-10a2a36d5d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:32:52 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-38ef1e4c-71ee-4e2d-9906-0c9963388e6f tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Created volume successfully. Sep 17 07:32:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "cinder-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:32:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:32:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "cinder-quobyte-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:32:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-quobyte-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:32:54 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[843ce205-9b60-400b-8b09-2f3261f70cd4]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:32:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:54 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794 Sep 17 07:32:54 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:54 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794" returned: 0 in 0.445s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:54 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794 Sep 17 07:32:54 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:55 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794" returned: 0 in 0.327s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-quobyte-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794" released by "delete_volume" :: held 0.830s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Created reservations ['0c29ddd3-ed8c-4312-aebf-cb97f7e58905', '4b315735-c311-44c8-98f4-d7c9be1fca2b', '27c34356-18ba-4194-b024-14d8b831ebff', 'f051efab-c704-477f-9849-564c7278d3d8'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:55 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:32:55 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "cinder-81724a6d-22fa-4c2d-8793-c440b98716d7-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-81724a6d-22fa-4c2d-8793-c440b98716d7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "cinder-quobyte-81724a6d-22fa-4c2d-8793-c440b98716d7" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-quobyte-81724a6d-22fa-4c2d-8793-c440b98716d7" acquired by "delete_volume" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[670a75ae-e930-47a0-a3a3-0936ff0da12a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81724a6d-22fa-4c2d-8793-c440b98716d7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:55 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.396s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:32:55 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Deleted volume successfully. Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-68316be7-ffd6-451b-9e8d-6b9a3cdd6e5c tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-d387e7a4-ec9a-4ab9-a93e-9d8d3df37794-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:32:55 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81724a6d-22fa-4c2d-8793-c440b98716d7 Sep 17 07:32:55 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:55 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81724a6d-22fa-4c2d-8793-c440b98716d7" returned: 0 in 0.447s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81724a6d-22fa-4c2d-8793-c440b98716d7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:55 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81724a6d-22fa-4c2d-8793-c440b98716d7 Sep 17 07:32:55 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:56 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-81724a6d-22fa-4c2d-8793-c440b98716d7" returned: 0 in 0.264s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-quobyte-81724a6d-22fa-4c2d-8793-c440b98716d7" released by "delete_volume" :: held 0.782s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Created reservations ['f8c5fd9e-216e-43dc-9661-831e80785c8e', '76adfcc1-7068-4e1b-835d-608173435b83', '589f48db-482b-4a1c-adde-13cecacfa1eb', 'b09f48db-33be-4275-ba4d-e638c5244acd'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:56 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:32:56 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "cinder-d1387844-697a-4767-93ac-cf2f8b3f7584-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:32:56 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.270s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-d1387844-697a-4767-93ac-cf2f8b3f7584-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:32:56 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Deleted volume successfully. Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e4a370b-ce63-4a56-8d34-1a2b9dbebba8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-81724a6d-22fa-4c2d-8793-c440b98716d7-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "cinder-quobyte-d1387844-697a-4767-93ac-cf2f8b3f7584" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-quobyte-d1387844-697a-4767-93ac-cf2f8b3f7584" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eef73d8-3ca0-4807-90e9-b13dcdd42766]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:32:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1387844-697a-4767-93ac-cf2f8b3f7584 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:56 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1387844-697a-4767-93ac-cf2f8b3f7584 Sep 17 07:32:56 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:57 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1387844-697a-4767-93ac-cf2f8b3f7584" returned: 0 in 0.379s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1387844-697a-4767-93ac-cf2f8b3f7584 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:57 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1387844-697a-4767-93ac-cf2f8b3f7584 Sep 17 07:32:57 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:57 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1387844-697a-4767-93ac-cf2f8b3f7584" returned: 0 in 0.255s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-quobyte-d1387844-697a-4767-93ac-cf2f8b3f7584" released by "delete_volume" :: held 0.686s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Created reservations ['2f694fb2-c42d-4893-a78c-67c6bc01e844', '781d45c9-4712-45a4-bf3a-5ff2f9bbd248', 'ea273ba1-cd9f-4bf0-8ef3-23106eaf5782', '62c2ffed-86b7-4e23-afbe-00308752faca'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:57 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:32:57 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:57 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.284s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "cinder-676d51a4-237b-4aa3-8e79-665fb364fbea-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:32:57 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Deleted volume successfully. Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3bc7c3f9-4aa0-4b56-afb3-0430758f9c28 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-d1387844-697a-4767-93ac-cf2f8b3f7584-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-676d51a4-237b-4aa3-8e79-665fb364fbea-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "cinder-quobyte-676d51a4-237b-4aa3-8e79-665fb364fbea" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-quobyte-676d51a4-237b-4aa3-8e79-665fb364fbea" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2624b31-353d-4432-a754-1372ae338974]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:32:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-676d51a4-237b-4aa3-8e79-665fb364fbea {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:58 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-676d51a4-237b-4aa3-8e79-665fb364fbea Sep 17 07:32:58 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:58 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-676d51a4-237b-4aa3-8e79-665fb364fbea" returned: 0 in 0.364s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-676d51a4-237b-4aa3-8e79-665fb364fbea {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:58 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-676d51a4-237b-4aa3-8e79-665fb364fbea Sep 17 07:32:58 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:58 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-676d51a4-237b-4aa3-8e79-665fb364fbea" returned: 0 in 0.264s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-quobyte-676d51a4-237b-4aa3-8e79-665fb364fbea" released by "delete_volume" :: held 0.672s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:32:58 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Created reservations ['af6e940e-14cd-424c-8269-adaf35a60aab', '551c7837-7453-441b-b025-8627520a06a3', 'a7b2c375-b13b-447c-92d7-78e820d782fc', 'a08c5bd0-cd38-4879-8700-d9f6132e4ded'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:32:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:58 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:32:58 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:58 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.267s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:58 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:32:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Deleted volume successfully. Sep 17 07:32:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a447afbc-7e8d-4b3f-bb30-e7e3f552dbe8 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-676d51a4-237b-4aa3-8e79-665fb364fbea-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "cinder-482f9405-00de-463c-b147-9b6ef277cf73-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-482f9405-00de-463c-b147-9b6ef277cf73-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "cinder-quobyte-482f9405-00de-463c-b147-9b6ef277cf73" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-quobyte-482f9405-00de-463c-b147-9b6ef277cf73" acquired by "delete_volume" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb127ac-54ff-4e10-b7ed-89b4a78cc9f5]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-482f9405-00de-463c-b147-9b6ef277cf73 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:59 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-482f9405-00de-463c-b147-9b6ef277cf73 Sep 17 07:32:59 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:59 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-482f9405-00de-463c-b147-9b6ef277cf73" returned: 0 in 0.394s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-482f9405-00de-463c-b147-9b6ef277cf73 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:59 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-482f9405-00de-463c-b147-9b6ef277cf73 Sep 17 07:32:59 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:32:59 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-482f9405-00de-463c-b147-9b6ef277cf73" returned: 0 in 0.281s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-quobyte-482f9405-00de-463c-b147-9b6ef277cf73" released by "delete_volume" :: held 0.734s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Created reservations ['962869a3-33e8-4433-b328-eaf07cb7156c', '5ff99052-78e6-4fa9-bf60-d7d308ebd3d2', '857524cf-4116-4bd5-b2b2-211524497a4f', 'e1ce64bb-39bf-45d4-af21-36cdb0aedee6'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:32:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:32:59 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:32:59 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "cinder-c941283e-a6f2-4e51-9e3e-3675ad8da82b-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:00 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.250s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:00 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:33:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Deleted volume successfully. Sep 17 07:33:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-c941283e-a6f2-4e51-9e3e-3675ad8da82b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c65df30d-20bb-4398-9536-1ad639bb0f23 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-482f9405-00de-463c-b147-9b6ef277cf73-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:33:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "cinder-quobyte-c941283e-a6f2-4e51-9e3e-3675ad8da82b" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-quobyte-c941283e-a6f2-4e51-9e3e-3675ad8da82b" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:00 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb237974-150c-4336-a4eb-b71e93d8715d]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:33:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:00 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b Sep 17 07:33:00 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:00 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b" returned: 0 in 0.372s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:00 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b Sep 17 07:33:00 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:00 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-c941283e-a6f2-4e51-9e3e-3675ad8da82b" returned: 0 in 0.247s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-quobyte-c941283e-a6f2-4e51-9e3e-3675ad8da82b" released by "delete_volume" :: held 0.676s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:33:00 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Created reservations ['fbf85457-0e2f-4af1-ac4f-1e8b4a0fb328', 'da544656-806d-4d60-bb84-c550c515ac50', '0b19baf4-e427-4205-ae19-cda1ea597946', 'a77ee78b-a244-4b38-818f-2f531910e87e'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:33:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:01 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:33:01 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:01 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.242s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:01 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:33:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Deleted volume successfully. Sep 17 07:33:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8982ab11-a0e0-4d99-bf6a-b8ba4a91d281 tempest-CreateVolumesFromSourceVolumeTest-1808793994 None] Lock "cinder-c941283e-a6f2-4e51-9e3e-3675ad8da82b-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Flow 'volume_create_manager' (69cfd65c-019e-4f63-8a09-1b2a0580f6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d83a0c-2800-46b6-a67d-15ac787e888b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d83a0c-2800-46b6-a67d-15ac787e888b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5071faad-ff47-40b7-ad08-0fee67ff3fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51a197b5f6441888960687b5479d507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:04Z,use_quota=True,user_id='6de3214827f1450499868cd569e7a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9abd295-7e39-4b66-be88-cb93b4d4d54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9abd295-7e39-4b66-be88-cb93b4d4d54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b0feb4-d6bd-4a00-8ba2-c36d5685a376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b0feb4-d6bd-4a00-8ba2-c36d5685a376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5071faad-ff47-40b7-ad08-0fee67ff3fa4', 'volume_name': 'volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4f0a47-b3c0-40d0-a7f5-13189e74694d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4f0a47-b3c0-40d0-a7f5-13189e74694d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7135b23f-189f-4659-918e-b11e83a50dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:04 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Volume 5071faad-ff47-40b7-ad08-0fee67ff3fa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4', 'volume_size': 1} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5071faad-ff47-40b7-ad08-0fee67ff3fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51a197b5f6441888960687b5479d507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:04Z,use_quota=True,user_id='6de3214827f1450499868cd569e7a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Creating volume 5071faad-ff47-40b7-ad08-0fee67ff3fa4 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:33:04 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:04 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4 1073741824 Sep 17 07:33:04 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:04 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:33:04 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:04 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4 1073741824" returned: 0 in 0.516s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:05 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4 Sep 17 07:33:05 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:05 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.293s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:33:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:33:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:33:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:33:05 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4" returned: 0 in 0.274s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:33:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7135b23f-189f-4659-918e-b11e83a50dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c14886-0c9c-43f7-a255-1234f50a8fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:05 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Volume volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4 (5071faad-ff47-40b7-ad08-0fee67ff3fa4): created successfully Sep 17 07:33:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c14886-0c9c-43f7-a255-1234f50a8fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Flow 'volume_create_manager' (69cfd65c-019e-4f63-8a09-1b2a0580f6a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:05 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d559dbdc-6e80-45b7-a265-a469840e811a tempest-CinderUnicodeTest-1316435344 None] Created volume successfully. Sep 17 07:33:06 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:33:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Flow 'volume_create_manager' (f80c04e8-b5ff-4c18-aafa-6da163de9654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29257afd-8ea8-4216-8a3a-17968df8c7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29257afd-8ea8-4216-8a3a-17968df8c7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2133133478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be22397-afa9-425d-8e13-4487f0fbf72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51a197b5f6441888960687b5479d507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:07Z,use_quota=True,user_id='6de3214827f1450499868cd569e7a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98ecfc7-ae37-46e2-aee7-3b69aecfe48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98ecfc7-ae37-46e2-aee7-3b69aecfe48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba05b5e-8630-442a-a3d9-cc2dbbcaf96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba05b5e-8630-442a-a3d9-cc2dbbcaf96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be22397-afa9-425d-8e13-4487f0fbf72a', 'volume_name': 'volume-1be22397-afa9-425d-8e13-4487f0fbf72a', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba12c801-f926-4f88-b445-4e12e085cad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba12c801-f926-4f88-b445-4e12e085cad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c98c73-81d3-4640-84df-ad46667b6831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:07 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Volume 1be22397-afa9-425d-8e13-4487f0fbf72a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be22397-afa9-425d-8e13-4487f0fbf72a', 'volume_size': 1} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2133133478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be22397-afa9-425d-8e13-4487f0fbf72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51a197b5f6441888960687b5479d507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:07Z,use_quota=True,user_id='6de3214827f1450499868cd569e7a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Creating volume 1be22397-afa9-425d-8e13-4487f0fbf72a {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:33:07 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:07 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a 1073741824 Sep 17 07:33:07 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:07 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a 1073741824" returned: 0 in 0.409s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:07 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a Sep 17 07:33:07 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:07 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a" returned: 0 in 0.282s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c98c73-81d3-4640-84df-ad46667b6831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be22397-afa9-425d-8e13-4487f0fbf72a', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7efbe86-bf7c-4089-a2e4-82219d3eb13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:07 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Volume volume-1be22397-afa9-425d-8e13-4487f0fbf72a (1be22397-afa9-425d-8e13-4487f0fbf72a): created successfully Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7efbe86-bf7c-4089-a2e4-82219d3eb13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Flow 'volume_create_manager' (f80c04e8-b5ff-4c18-aafa-6da163de9654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:07 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-6bdd14cd-cc24-4546-bb6c-477845d05f09 tempest-CinderUnicodeTest-1316435344 None] Created volume successfully. Sep 17 07:33:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] Creating offline snapshot 99a910b6-7a11-44b0-9b1d-ce42bfe61c36 of volume 1be22397-afa9-425d-8e13-4487f0fbf72a {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:33:08 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[101b1902-b07d-4a68-8b1a-1bf892bef40b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:33:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:08 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a Sep 17 07:33:08 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:08 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a" returned: 0 in 0.434s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:08 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 1G Sep 17 07:33:08 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-a56119a0-0881-470b-a444-bfce0d605c86 req-e0d798cc-2d54-4faa-aa9a-53f541b58b45 tempest-TestStampPattern-309290661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:09 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 1G" returned: 0 in 0.408s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be22397-afa9-425d-8e13-4487f0fbf72a -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:09 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be22397-afa9-425d-8e13-4487f0fbf72a -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 Sep 17 07:33:09 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:09 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be22397-afa9-425d-8e13-4487f0fbf72a -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36" returned: 0 in 0.300s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:09 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 is being set with open permissions: ugo+rw Sep 17 07:33:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:09 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 Sep 17 07:33:09 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:09 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36" returned: 0 in 0.259s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:09 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.info Sep 17 07:33:09 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:09 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.info" returned: 0 in 0.258s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:09 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.info is being set with open permissions: ugo+rw Sep 17 07:33:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:09 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.info Sep 17 07:33:09 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:10 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.info" returned: 0 in 0.242s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.997s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-a56119a0-0881-470b-a444-bfce0d605c86 req-e0d798cc-2d54-4faa-aa9a-53f541b58b45 tempest-TestStampPattern-309290661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.253s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:10 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=76,cinder:INSERT=20,cinder:UPDATE=93,cinder:DELETE=7 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:33:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-a56119a0-0881-470b-a444-bfce0d605c86 req-e0d798cc-2d54-4faa-aa9a-53f541b58b45 tempest-TestStampPattern-309290661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:10 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-65ee9c9e-7b34-43ef-9fb7-657d337ca6b7 tempest-CinderUnicodeTest-1316435344 None] Create snapshot completed successfully Sep 17 07:33:10 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-a56119a0-0881-470b-a444-bfce0d605c86 req-e0d798cc-2d54-4faa-aa9a-53f541b58b45 tempest-TestStampPattern-309290661 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-01a537fe-f2ca-456f-ace1-221e24aec9c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c761d916-77ea-440b-8bdc-e7e2942ce9d3', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:33:10 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-a56119a0-0881-470b-a444-bfce0d605c86 req-e0d798cc-2d54-4faa-aa9a-53f541b58b45 tempest-TestStampPattern-309290661 None] attachment_update completed successfully. Sep 17 07:33:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Acquiring lock "cinder-99a910b6-7a11-44b0-9b1d-ce42bfe61c36-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Lock "cinder-99a910b6-7a11-44b0-9b1d-ce42bfe61c36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Acquiring lock "cinder-quobyte-1be22397-afa9-425d-8e13-4487f0fbf72a" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Lock "cinder-quobyte-1be22397-afa9-425d-8e13-4487f0fbf72a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Acquiring lock "cinder-quobyte-99a910b6-7a11-44b0-9b1d-ce42bfe61c36" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Lock "cinder-quobyte-99a910b6-7a11-44b0-9b1d-ce42bfe61c36" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Deleting offline snapshot 99a910b6-7a11-44b0-9b1d-ce42bfe61c36 of volume 1be22397-afa9-425d-8e13-4487f0fbf72a {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:33:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] snapshot_file for this snap is: volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:33:11 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceccfe5-4a0d-43d1-b131-f2dd41e37f29]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:33:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:11 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 Sep 17 07:33:11 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:11 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36" returned: 0 in 0.391s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1be22397-afa9-425d-8e13-4487f0fbf72a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:33:11 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e155b81d-262c-4e41-a4e9-0414f7732cc7]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:33:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:12 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a Sep 17 07:33:12 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:12 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a" returned: 0 in 0.399s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:12 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 Sep 17 07:33:12 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:12 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36" returned: 0 in 0.376s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:12 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36 Sep 17 07:33:12 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:12 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a.99a910b6-7a11-44b0-9b1d-ce42bfe61c36" returned: 0 in 0.281s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Lock "cinder-quobyte-99a910b6-7a11-44b0-9b1d-ce42bfe61c36" released by "_delete_snapshot" :: held 1.563s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:33:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Lock "cinder-quobyte-1be22397-afa9-425d-8e13-4487f0fbf72a" released by "delete_snapshot" :: held 1.587s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:33:13 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Created reservations ['98de6d23-bb14-4ea0-984b-c47b0e89d289', '147dfc13-291a-4b7b-8b1c-0e39021b2c89', '4aa312db-3c17-4059-90db-a681d36cda3d', '5aedb4b4-e0c2-439d-a0aa-0502b16da381'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:33:13 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Delete snapshot completed successfully. Sep 17 07:33:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-88a393be-9428-4030-aec4-4d4be3978fa4 tempest-CinderUnicodeTest-1316435344 None] Lock "cinder-99a910b6-7a11-44b0-9b1d-ce42bfe61c36-delete_snapshot" released by "delete_snapshot" :: held 1.773s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:33:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Acquiring lock "cinder-1be22397-afa9-425d-8e13-4487f0fbf72a-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Lock "cinder-1be22397-afa9-425d-8e13-4487f0fbf72a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Acquiring lock "cinder-quobyte-1be22397-afa9-425d-8e13-4487f0fbf72a" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Lock "cinder-quobyte-1be22397-afa9-425d-8e13-4487f0fbf72a" acquired by "delete_volume" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:13 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[650687e1-f01e-41aa-b075-00ce34047ff0]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:33:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:13 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a Sep 17 07:33:13 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:14 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a" returned: 0 in 0.471s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:14 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a Sep 17 07:33:14 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:14 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-1be22397-afa9-425d-8e13-4487f0fbf72a" returned: 0 in 0.264s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Lock "cinder-quobyte-1be22397-afa9-425d-8e13-4487f0fbf72a" released by "delete_volume" :: held 0.811s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Created reservations ['9e2549a7-dd1f-4946-a58b-023555ccbe11', '2a2857e7-6147-43de-919c-48089012e580', 'a7ba1b23-36f9-423f-84e6-b4bfe331e37c', '54ff2eb8-4896-475e-bf54-41c12a45c870'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:14 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:33:14 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Acquiring lock "cinder-5071faad-ff47-40b7-ad08-0fee67ff3fa4-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Lock "cinder-5071faad-ff47-40b7-ad08-0fee67ff3fa4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Acquiring lock "cinder-quobyte-5071faad-ff47-40b7-ad08-0fee67ff3fa4" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Lock "cinder-quobyte-5071faad-ff47-40b7-ad08-0fee67ff3fa4" acquired by "delete_volume" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:15 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.320s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:33:15 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Deleted volume successfully. Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cd425d-dbe5-4019-830c-06542ab7e5e4]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-62d978bc-3c36-4e45-95eb-bb3ac749b013 tempest-CinderUnicodeTest-1316435344 None] Lock "cinder-1be22397-afa9-425d-8e13-4487f0fbf72a-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:33:15 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4 Sep 17 07:33:15 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:15 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4" returned: 0 in 0.453s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:15 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4 Sep 17 07:33:15 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:15 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-262fe08b-a9fc-4636-9039-5a5d5e78139c req-5a45acc1-1404-4a5d-ac34-9605853f96d2 tempest-TestStampPattern-309290661 None] Terminate volume connection completed successfully. Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-262fe08b-a9fc-4636-9039-5a5d5e78139c req-5a45acc1-1404-4a5d-ac34-9605853f96d2 tempest-TestStampPattern-309290661 None] Deleting attachment c761d916-77ea-440b-8bdc-e7e2942ce9d3. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:33:15 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5071faad-ff47-40b7-ad08-0fee67ff3fa4" returned: 0 in 0.280s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Lock "cinder-quobyte-5071faad-ff47-40b7-ad08-0fee67ff3fa4" released by "delete_volume" :: held 0.796s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Created reservations ['0d131449-8f87-4437-b19d-e8b396c1cb5a', '006a8841-4993-4bfc-b0de-643b46a9e1f7', '5d9b2c46-de77-458f-b4e5-c548baebda30', '01c34e2f-5859-4d03-9d68-0bd4a6e52b5d'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:15 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:33:15 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:16 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.263s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:16 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:33:16 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Deleted volume successfully. Sep 17 07:33:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6c2290ef-a5de-467f-a44c-74734189b1c2 tempest-CinderUnicodeTest-1316435344 None] Lock "cinder-5071faad-ff47-40b7-ad08-0fee67ff3fa4-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:33:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] Creating offline snapshot 20cf703b-2d41-4b25-8e22-38972bf63971 of volume 01a537fe-f2ca-456f-ace1-221e24aec9c7 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:33:16 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[01668d2c-34be-4722-90bd-86ba052ea96f]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:33:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:16 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 Sep 17 07:33:16 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:17 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7" returned: 0 in 0.462s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:17 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 1G Sep 17 07:33:17 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:17 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 1G" returned: 0 in 0.447s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:17 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 Sep 17 07:33:17 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:17 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971" returned: 0 in 0.298s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:17 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 is being set with open permissions: ugo+rw Sep 17 07:33:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:17 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 Sep 17 07:33:17 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:18 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971" returned: 0 in 0.247s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:18 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.info Sep 17 07:33:18 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:18 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.info" returned: 0 in 0.243s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:18 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.info is being set with open permissions: ugo+rw Sep 17 07:33:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:18 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.info Sep 17 07:33:18 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:18 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.info" returned: 0 in 0.234s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:18 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b440175e-8f3a-4c87-96b4-66dcb7f9b1e6 tempest-TestStampPattern-309290661 None] Create snapshot completed successfully Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Flow 'volume_create_manager' (c0c3ba48-8f9c-4bec-91ae-4fa827a91f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1beb49-10c3-4271-9be6-1575beef657e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1beb49-10c3-4271-9be6-1575beef657e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1844087359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df40a49-8445-44cd-ae2c-b19d8571a3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cf3308e4904df7841a509312652c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=20cf703b-2d41-4b25-8e22-38972bf63971,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:27Z,use_quota=True,user_id='134e561cb6c340489a170577999d450e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d01e92b-7d1d-47e5-93af-35f9349c8583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d01e92b-7d1d-47e5-93af-35f9349c8583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee35317-de2e-4a04-8c6f-0a860836896e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee35317-de2e-4a04-8c6f-0a860836896e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7df40a49-8445-44cd-ae2c-b19d8571a3e3', 'volume_name': 'volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3', 'volume_size': 1, 'snapshot_id': '20cf703b-2d41-4b25-8e22-38972bf63971'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c0860f-53df-4e86-b5e6-da54821da384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c0860f-53df-4e86-b5e6-da54821da384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93951b46-6367-4bd2-aa69-564a50566786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:26 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Volume 7df40a49-8445-44cd-ae2c-b19d8571a3e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3', 'volume_size': 1, 'snapshot_id': '20cf703b-2d41-4b25-8e22-38972bf63971'} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Acquiring lock "cinder-quobyte-20cf703b-2d41-4b25-8e22-38972bf63971-7df40a49-8445-44cd-ae2c-b19d8571a3e3" by "_create_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Lock "cinder-quobyte-20cf703b-2d41-4b25-8e22-38972bf63971-7df40a49-8445-44cd-ae2c-b19d8571a3e3" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Creating volume 7df40a49-8445-44cd-ae2c-b19d8571a3e3 from snapshot 20cf703b-2d41-4b25-8e22-38972bf63971 {{(pid=86029) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Acquiring lock "cinder-quobyte-7df40a49-8445-44cd-ae2c-b19d8571a3e3" by "_copy_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Lock "cinder-quobyte-7df40a49-8445-44cd-ae2c-b19d8571a3e3" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] snapshot: 20cf703b-2d41-4b25-8e22-38972bf63971, volume: 7df40a49-8445-44cd-ae2c-b19d8571a3e3, {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ad73f9-6427-45ba-a39e-2ca6939b6c36]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:33:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:27 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 Sep 17 07:33:27 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:27 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971" returned: 0 in 0.442s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01a537fe-f2ca-456f-ace1-221e24aec9c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:33:27 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5564371-4b70-4470-8ed3-0fdbaaa072f9]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:33:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:27 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 Sep 17 07:33:27 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:27 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7" returned: 0 in 0.457s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] will copy from snapshot at /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 07:33:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Creating direct copy from snapshot {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 07:33:27 devstack cinder-volume[86029]: DEBUG cinder.utils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Path /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3 not found in is_blk_device check {{(pid=86029) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 07:33:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:27 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3 Sep 17 07:33:27 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:28 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-52290b1a-d02b-4850-86cb-da37de96ead6 req-c994b171-a367-4886-bf0e-2c9d25ff76fe tempest-TestMinimumBasicScenario-1881341440 None] Terminate volume connection completed successfully. Sep 17 07:33:28 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-52290b1a-d02b-4850-86cb-da37de96ead6 req-c994b171-a367-4886-bf0e-2c9d25ff76fe tempest-TestMinimumBasicScenario-1881341440 None] Deleting attachment 1147feaa-5d1a-4f17-ab28-6aeced97ff35. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:33:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Acquiring lock "cinder-abc208ca-d79f-4fc7-ae35-7baf62269898-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Lock "cinder-abc208ca-d79f-4fc7-ae35-7baf62269898-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:29 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=87,cinder:UPDATE=107,cinder:INSERT=25,cinder:DELETE=13 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:33:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Acquiring lock "cinder-quobyte-abc208ca-d79f-4fc7-ae35-7baf62269898" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Lock "cinder-quobyte-abc208ca-d79f-4fc7-ae35-7baf62269898" acquired by "delete_volume" :: waited 0.043s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:29 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5525b7df-cc84-4286-b9f0-1030216564bd]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:33:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-abc208ca-d79f-4fc7-ae35-7baf62269898 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:30 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-abc208ca-d79f-4fc7-ae35-7baf62269898 Sep 17 07:33:30 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:30 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-abc208ca-d79f-4fc7-ae35-7baf62269898" returned: 0 in 0.956s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-abc208ca-d79f-4fc7-ae35-7baf62269898 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:30 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-abc208ca-d79f-4fc7-ae35-7baf62269898 Sep 17 07:33:30 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:31 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-abc208ca-d79f-4fc7-ae35-7baf62269898" returned: 0 in 0.932s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Lock "cinder-quobyte-abc208ca-d79f-4fc7-ae35-7baf62269898" released by "delete_volume" :: held 2.058s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:33:31 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Created reservations ['3459b3a2-f5a0-4c37-8d18-efeaec96f341', 'ab03c218-8024-427c-9361-4fece645274a', 'bd54b820-8281-4d55-90dd-8dce9e699ec9', '17ad47e3-d7ef-4803-bd93-b81c930a8162'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:33:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:31 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:33:31 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:32 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.572s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:32 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:33:32 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Deleted volume successfully. Sep 17 07:33:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-51d1b4b3-6963-4d7c-943a-f7cd1c97b8a7 tempest-TestMinimumBasicScenario-1881341440 None] Lock "cinder-abc208ca-d79f-4fc7-ae35-7baf62269898-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:33:38 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3" returned: 0 in 10.557s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:38 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7, size 1024.00 MB, duration 10.56 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:33:38 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Converted 1024.00 MB image at 96.98 MB/s Sep 17 07:33:38 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3 is being set with open permissions: ugo+rw Sep 17 07:33:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:38 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3 Sep 17 07:33:38 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:38 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3" returned: 0 in 0.283s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Lock "cinder-quobyte-7df40a49-8445-44cd-ae2c-b19d8571a3e3" released by "_copy_volume_from_snapshot" :: held 11.860s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:33:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Lock "cinder-quobyte-20cf703b-2d41-4b25-8e22-38972bf63971-7df40a49-8445-44cd-ae2c-b19d8571a3e3" released by "_create_volume_from_snapshot" :: held 11.980s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:33:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.997s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93951b46-6367-4bd2-aa69-564a50566786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3', 'volume_size': 1, 'snapshot_id': '20cf703b-2d41-4b25-8e22-38972bf63971'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bb5d76-7ede-4e38-a617-9431259adab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:38 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Volume volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3 (7df40a49-8445-44cd-ae2c-b19d8571a3e3): created successfully Sep 17 07:33:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bb5d76-7ede-4e38-a617-9431259adab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:38 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Flow 'volume_create_manager' (c0c3ba48-8f9c-4bec-91ae-4fa827a91f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:38 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-ebfc4706-7a05-4358-bf84-f0aaf415bdbc tempest-TestStampPattern-309290661 None] Created volume successfully. Sep 17 07:33:48 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=13 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:33:48 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=35,cinder:UPDATE=36,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Flow 'volume_create_manager' (cb0105ad-41fa-420d-983a-c6998f19c4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd40baf4-f1f5-4082-ae1f-6c80acf4245d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd40baf4-f1f5-4082-ae1f-6c80acf4245d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-62921194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0fc9ed-879e-48c4-9f91-ca620b749bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed0bf8ddd39438e8f8610b56d0c4abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:51Z,use_quota=True,user_id='3fc6759f3cdf451997d4a9559bc574c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b7e90c-d70a-40cc-9dfd-c4cbe064bd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b7e90c-d70a-40cc-9dfd-c4cbe064bd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0074bf79-ccba-4874-af44-2936353f8b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0074bf79-ccba-4874-af44-2936353f8b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf0fc9ed-879e-48c4-9f91-ca620b749bef', 'volume_name': 'volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23673cd1-3cb0-45c6-b968-d0b2f904593f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23673cd1-3cb0-45c6-b968-d0b2f904593f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7f40d1-0c8d-47f0-b8ee-b874223eb769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:50 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume bf0fc9ed-879e-48c4-9f91-ca620b749bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef', 'volume_size': 1} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-62921194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0fc9ed-879e-48c4-9f91-ca620b749bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed0bf8ddd39438e8f8610b56d0c4abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:51Z,use_quota=True,user_id='3fc6759f3cdf451997d4a9559bc574c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Creating volume bf0fc9ed-879e-48c4-9f91-ca620b749bef {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:33:50 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:33:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:50 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef 1073741824 Sep 17 07:33:50 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:51 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef 1073741824" returned: 0 in 0.446s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:51 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef Sep 17 07:33:51 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:51 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef" returned: 0 in 0.248s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:33:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7f40d1-0c8d-47f0-b8ee-b874223eb769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfe7c66-e556-48ef-bfe9-2f27bdd660c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:51 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef (bf0fc9ed-879e-48c4-9f91-ca620b749bef): created successfully Sep 17 07:33:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfe7c66-e556-48ef-bfe9-2f27bdd660c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Flow 'volume_create_manager' (cb0105ad-41fa-420d-983a-c6998f19c4df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:51 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0658c762-e6e4-46af-8c58-82cbdc7234d6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Created volume successfully. Sep 17 07:33:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Creating offline snapshot 2beecf0f-f5c7-42cb-a421-6dd2435e0213 of volume bf0fc9ed-879e-48c4-9f91-ca620b749bef {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:33:51 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[90eb8305-492b-4f17-80db-35e84988ee7b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:33:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:52 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef Sep 17 07:33:52 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:52 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef" returned: 0 in 0.369s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:52 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 1G Sep 17 07:33:52 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:52 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 1G" returned: 0 in 0.394s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:52 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 Sep 17 07:33:52 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:52 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213" returned: 0 in 0.280s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:52 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 is being set with open permissions: ugo+rw Sep 17 07:33:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:53 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 Sep 17 07:33:53 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:53 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213" returned: 0 in 0.245s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:53 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.info Sep 17 07:33:53 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:53 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.info" returned: 0 in 0.249s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:53 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.info is being set with open permissions: ugo+rw Sep 17 07:33:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:53 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.info Sep 17 07:33:53 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:53 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.info" returned: 0 in 0.248s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:53 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-5e3cef25-85df-4a0e-a7d8-ed9a90aeb184 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Create snapshot completed successfully Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Flow 'volume_create_manager' (441d6bd4-deb2-4ca2-9b06-a81f0747da73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5646e79b-694e-4e47-a123-0a4c781571a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5646e79b-694e-4e47-a123-0a4c781571a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-71775348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7881f5f4-b76d-480d-91b3-89c87c291f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed0bf8ddd39438e8f8610b56d0c4abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:54Z,use_quota=True,user_id='3fc6759f3cdf451997d4a9559bc574c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387f3997-678d-41aa-a4aa-82c069beafdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387f3997-678d-41aa-a4aa-82c069beafdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d38e42-117c-4528-b5ab-ce7b1bdab747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d38e42-117c-4528-b5ab-ce7b1bdab747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7881f5f4-b76d-480d-91b3-89c87c291f2f', 'volume_name': 'volume-7881f5f4-b76d-480d-91b3-89c87c291f2f', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ba9d22-c5e3-46e4-8000-5be38c9d23cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ba9d22-c5e3-46e4-8000-5be38c9d23cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd586ed-2d9b-46f2-bfd9-daa390e898f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:54 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume 7881f5f4-b76d-480d-91b3-89c87c291f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7881f5f4-b76d-480d-91b3-89c87c291f2f', 'volume_size': 1} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-71775348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7881f5f4-b76d-480d-91b3-89c87c291f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed0bf8ddd39438e8f8610b56d0c4abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:54Z,use_quota=True,user_id='3fc6759f3cdf451997d4a9559bc574c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Creating volume 7881f5f4-b76d-480d-91b3-89c87c291f2f {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:33:54 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7881f5f4-b76d-480d-91b3-89c87c291f2f 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:54 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7881f5f4-b76d-480d-91b3-89c87c291f2f 1073741824 Sep 17 07:33:54 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Flow 'volume_create_manager' (3fcfd7b9-b184-4c60-82b8-edbed1be5bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ec700a-821d-4c1b-902c-cbc0d62e14a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ec700a-821d-4c1b-902c-cbc0d62e14a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1652070420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e6c7a9-32f3-4e91-85db-98990de78cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed0bf8ddd39438e8f8610b56d0c4abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:55Z,use_quota=True,user_id='3fc6759f3cdf451997d4a9559bc574c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3b0c22-6042-4a15-a658-78bf6f194653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3b0c22-6042-4a15-a658-78bf6f194653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2dc00f-57f8-43bd-a33e-3129cb535601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2dc00f-57f8-43bd-a33e-3129cb535601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e6c7a9-32f3-4e91-85db-98990de78cbe', 'volume_name': 'volume-45e6c7a9-32f3-4e91-85db-98990de78cbe', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (219468b9-6a30-4da1-a8b7-f99dc2ee60ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (219468b9-6a30-4da1-a8b7-f99dc2ee60ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fff89bd-fca0-4f18-80f1-7313c3d01073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:54 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume 45e6c7a9-32f3-4e91-85db-98990de78cbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e6c7a9-32f3-4e91-85db-98990de78cbe', 'volume_size': 1} Sep 17 07:33:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:55 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7881f5f4-b76d-480d-91b3-89c87c291f2f 1073741824" returned: 0 in 0.523s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7881f5f4-b76d-480d-91b3-89c87c291f2f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:55 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7881f5f4-b76d-480d-91b3-89c87c291f2f Sep 17 07:33:55 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Flow 'volume_create_manager' (03c08010-2501-43d6-a4f4-72bc913886c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506db140-aa44-409b-bc1e-9714a9bb1f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506db140-aa44-409b-bc1e-9714a9bb1f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1327189687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbdd5f6-d26b-4765-9699-8618f087e2ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed0bf8ddd39438e8f8610b56d0c4abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:55Z,use_quota=True,user_id='3fc6759f3cdf451997d4a9559bc574c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66976ac9-c921-4b64-84e3-5b138988e00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66976ac9-c921-4b64-84e3-5b138988e00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616e8c51-428e-4741-a4f7-ed64818e0ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616e8c51-428e-4741-a4f7-ed64818e0ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfbdd5f6-d26b-4765-9699-8618f087e2ac', 'volume_name': 'volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd42c1af-b9be-41a0-b26b-1f851a0db5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd42c1af-b9be-41a0-b26b-1f851a0db5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2361ea8f-1102-443b-ba8d-4de2425d9ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume cfbdd5f6-d26b-4765-9699-8618f087e2ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac', 'volume_size': 1} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:55 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7881f5f4-b76d-480d-91b3-89c87c291f2f" returned: 0 in 0.306s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.445s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1652070420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e6c7a9-32f3-4e91-85db-98990de78cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed0bf8ddd39438e8f8610b56d0c4abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:55Z,use_quota=True,user_id='3fc6759f3cdf451997d4a9559bc574c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Creating volume 45e6c7a9-32f3-4e91-85db-98990de78cbe {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:33:55 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-45e6c7a9-32f3-4e91-85db-98990de78cbe 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd586ed-2d9b-46f2-bfd9-daa390e898f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7881f5f4-b76d-480d-91b3-89c87c291f2f', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:55 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-45e6c7a9-32f3-4e91-85db-98990de78cbe 1073741824 Sep 17 07:33:55 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8605af-fc18-46ce-87c7-4de6d2934945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume volume-7881f5f4-b76d-480d-91b3-89c87c291f2f (7881f5f4-b76d-480d-91b3-89c87c291f2f): created successfully Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8605af-fc18-46ce-87c7-4de6d2934945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Flow 'volume_create_manager' (441d6bd4-deb2-4ca2-9b06-a81f0747da73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:55 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e2d6076c-931b-47b4-9dd1-72c0e5bbe31e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Created volume successfully. Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Flow 'volume_create_manager' (73172aa5-5f5e-4092-829e-f3f51662a3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab67ccf-5180-4c73-aa7b-d8d339906306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab67ccf-5180-4c73-aa7b-d8d339906306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-900051884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba549c5-760d-4b46-8dcd-4fea8ef1f69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed0bf8ddd39438e8f8610b56d0c4abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:55Z,use_quota=True,user_id='3fc6759f3cdf451997d4a9559bc574c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5a1921-92ff-4d6b-a22e-cbc94576dda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5a1921-92ff-4d6b-a22e-cbc94576dda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9bf74e6-b3cd-49cf-819b-71cf9d920661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9bf74e6-b3cd-49cf-819b-71cf9d920661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eba549c5-760d-4b46-8dcd-4fea8ef1f69f', 'volume_name': 'volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4588ddb9-55a9-40f7-809d-09aa5877b8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4588ddb9-55a9-40f7-809d-09aa5877b8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4105705-ccdd-4caf-ad06-e4f950bbcb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume eba549c5-760d-4b46-8dcd-4fea8ef1f69f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f', 'volume_size': 1} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Flow 'volume_create_manager' (e6b8d3b2-4d2a-4386-96a4-7ae4644227e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002c31c6-9261-426b-b9f8-7c333d731b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002c31c6-9261-426b-b9f8-7c333d731b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1254149040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910174a1-a0fc-43bb-9981-97ca365ed8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed0bf8ddd39438e8f8610b56d0c4abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:56Z,use_quota=True,user_id='3fc6759f3cdf451997d4a9559bc574c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e44f646-386f-49ef-bec3-07f82461b462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e44f646-386f-49ef-bec3-07f82461b462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fbe213-cd95-4172-85e4-8995cc55a280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fbe213-cd95-4172-85e4-8995cc55a280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910174a1-a0fc-43bb-9981-97ca365ed8e5', 'volume_name': 'volume-910174a1-a0fc-43bb-9981-97ca365ed8e5', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5d939b-49c9-4ba4-b02a-1fefb2e6727f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5d939b-49c9-4ba4-b02a-1fefb2e6727f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a7157e-4eed-4052-b8eb-c57fd3c98479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:55 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume 910174a1-a0fc-43bb-9981-97ca365ed8e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910174a1-a0fc-43bb-9981-97ca365ed8e5', 'volume_size': 1} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-45e6c7a9-32f3-4e91-85db-98990de78cbe 1073741824" returned: 0 in 0.560s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-45e6c7a9-32f3-4e91-85db-98990de78cbe {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:56 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-45e6c7a9-32f3-4e91-85db-98990de78cbe Sep 17 07:33:56 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:56 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-45e6c7a9-32f3-4e91-85db-98990de78cbe" returned: 0 in 0.244s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.995s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1327189687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbdd5f6-d26b-4765-9699-8618f087e2ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed0bf8ddd39438e8f8610b56d0c4abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:55Z,use_quota=True,user_id='3fc6759f3cdf451997d4a9559bc574c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Creating volume cfbdd5f6-d26b-4765-9699-8618f087e2ac {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:33:56 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fff89bd-fca0-4f18-80f1-7313c3d01073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e6c7a9-32f3-4e91-85db-98990de78cbe', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:56 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac 1073741824 Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed009132-de20-45ab-b4b0-daf366c9e36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:56 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:56 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume volume-45e6c7a9-32f3-4e91-85db-98990de78cbe (45e6c7a9-32f3-4e91-85db-98990de78cbe): created successfully Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed009132-de20-45ab-b4b0-daf366c9e36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Flow 'volume_create_manager' (3fcfd7b9-b184-4c60-82b8-edbed1be5bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:56 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-7fd87a19-5867-46e3-a8e7-4e4667db26cb tempest-CreateVolumesFromSnapshotTest-1575329151 None] Created volume successfully. Sep 17 07:33:56 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac 1073741824" returned: 0 in 0.421s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:56 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac Sep 17 07:33:56 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:56 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac" returned: 0 in 0.254s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.327s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-900051884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba549c5-760d-4b46-8dcd-4fea8ef1f69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed0bf8ddd39438e8f8610b56d0c4abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:55Z,use_quota=True,user_id='3fc6759f3cdf451997d4a9559bc574c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Creating volume eba549c5-760d-4b46-8dcd-4fea8ef1f69f {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:33:56 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2361ea8f-1102-443b-ba8d-4de2425d9ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:56 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f 1073741824 Sep 17 07:33:56 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f009168-cd54-4727-94ef-d98a9e645b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:56 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac (cfbdd5f6-d26b-4765-9699-8618f087e2ac): created successfully Sep 17 07:33:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f009168-cd54-4727-94ef-d98a9e645b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Flow 'volume_create_manager' (03c08010-2501-43d6-a4f4-72bc913886c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:57 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-f26d392c-3b65-4f8c-9304-32f563908477 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Created volume successfully. Sep 17 07:33:57 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f 1073741824" returned: 0 in 0.396s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:57 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f Sep 17 07:33:57 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:57 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f" returned: 0 in 0.254s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.689s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1254149040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910174a1-a0fc-43bb-9981-97ca365ed8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed0bf8ddd39438e8f8610b56d0c4abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:33:56Z,use_quota=True,user_id='3fc6759f3cdf451997d4a9559bc574c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Creating volume 910174a1-a0fc-43bb-9981-97ca365ed8e5 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:33:57 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-910174a1-a0fc-43bb-9981-97ca365ed8e5 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4105705-ccdd-4caf-ad06-e4f950bbcb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:57 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-910174a1-a0fc-43bb-9981-97ca365ed8e5 1073741824 Sep 17 07:33:57 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984b824e-f697-4f58-8a4f-69a2df52f675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:57 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f (eba549c5-760d-4b46-8dcd-4fea8ef1f69f): created successfully Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984b824e-f697-4f58-8a4f-69a2df52f675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Flow 'volume_create_manager' (73172aa5-5f5e-4092-829e-f3f51662a3a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:57 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8c043029-d5d7-4dbf-9796-9acc287dd114 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Created volume successfully. Sep 17 07:33:58 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-910174a1-a0fc-43bb-9981-97ca365ed8e5 1073741824" returned: 0 in 0.445s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-910174a1-a0fc-43bb-9981-97ca365ed8e5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:58 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-910174a1-a0fc-43bb-9981-97ca365ed8e5 Sep 17 07:33:58 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:58 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-910174a1-a0fc-43bb-9981-97ca365ed8e5" returned: 0 in 0.237s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:33:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:33:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a7157e-4eed-4052-b8eb-c57fd3c98479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910174a1-a0fc-43bb-9981-97ca365ed8e5', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02263c7f-3d88-4a0e-b27c-4a7f390212a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:33:58 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Volume volume-910174a1-a0fc-43bb-9981-97ca365ed8e5 (910174a1-a0fc-43bb-9981-97ca365ed8e5): created successfully Sep 17 07:33:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02263c7f-3d88-4a0e-b27c-4a7f390212a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:33:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Flow 'volume_create_manager' (e6b8d3b2-4d2a-4386-96a4-7ae4644227e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:33:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-66e5f426-682c-43a4-9702-987702c32403 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Created volume successfully. Sep 17 07:33:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-910174a1-a0fc-43bb-9981-97ca365ed8e5-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-910174a1-a0fc-43bb-9981-97ca365ed8e5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-quobyte-910174a1-a0fc-43bb-9981-97ca365ed8e5" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:33:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-910174a1-a0fc-43bb-9981-97ca365ed8e5" acquired by "delete_volume" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:33:59 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c725d6-8e3b-4006-a4b9-7cbf9f91b354]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:33:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-910174a1-a0fc-43bb-9981-97ca365ed8e5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:59 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-910174a1-a0fc-43bb-9981-97ca365ed8e5 Sep 17 07:33:59 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:59 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-910174a1-a0fc-43bb-9981-97ca365ed8e5" returned: 0 in 0.355s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-910174a1-a0fc-43bb-9981-97ca365ed8e5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:33:59 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-910174a1-a0fc-43bb-9981-97ca365ed8e5 Sep 17 07:33:59 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:33:59 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Sep 17 07:33:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-910174a1-a0fc-43bb-9981-97ca365ed8e5" returned: 0 in 0.253s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:33:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-910174a1-a0fc-43bb-9981-97ca365ed8e5" released by "delete_volume" :: held 0.647s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Created reservations ['8d1c84ea-a78d-4da3-b431-b9c2b61b592a', '1d6dbd68-c80b-4515-94f9-5f7b9b8eb669', 'f4974f76-1844-4a0c-a8d8-598158761775', '174be950-d2fe-4fdf-abc5-d187773a61ae'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:00 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:34:00 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:00 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.239s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:34:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Deleted volume successfully. Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b500647d-ee14-4a9a-a527-cccc23c8dba6 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-910174a1-a0fc-43bb-9981-97ca365ed8e5-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-eba549c5-760d-4b46-8dcd-4fea8ef1f69f-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-eba549c5-760d-4b46-8dcd-4fea8ef1f69f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-quobyte-eba549c5-760d-4b46-8dcd-4fea8ef1f69f" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-eba549c5-760d-4b46-8dcd-4fea8ef1f69f" acquired by "delete_volume" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ae0e9-46b4-4fd1-a6fa-b769abe41412]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:00 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f Sep 17 07:34:00 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:00 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f" returned: 0 in 0.368s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:00 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f Sep 17 07:34:00 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:01 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eba549c5-760d-4b46-8dcd-4fea8ef1f69f" returned: 0 in 0.245s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-eba549c5-760d-4b46-8dcd-4fea8ef1f69f" released by "delete_volume" :: held 0.653s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Created reservations ['1eff2c17-8a2b-4db6-a902-3c9c82bd2be3', '110b534e-bb2f-4f15-b4b3-c688d5f94114', '8b35c1ba-51c2-4779-ad2a-f6e97c6df9bc', '6e645c8d-ff5d-4e95-b7b2-e8063fb822c8'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:01 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:34:01 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:01 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.240s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:34:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Deleted volume successfully. Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-39d1ef17-3733-46c7-bd59-d5b2a89b576c tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-eba549c5-760d-4b46-8dcd-4fea8ef1f69f-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-cfbdd5f6-d26b-4765-9699-8618f087e2ac-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-cfbdd5f6-d26b-4765-9699-8618f087e2ac-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-quobyte-cfbdd5f6-d26b-4765-9699-8618f087e2ac" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-cfbdd5f6-d26b-4765-9699-8618f087e2ac" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5771a0d1-7ea0-457e-a838-70a6e2ce632f]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:01 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac Sep 17 07:34:01 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:01 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac" returned: 0 in 0.353s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:02 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac Sep 17 07:34:02 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:02 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cfbdd5f6-d26b-4765-9699-8618f087e2ac" returned: 0 in 0.243s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-cfbdd5f6-d26b-4765-9699-8618f087e2ac" released by "delete_volume" :: held 0.636s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Created reservations ['94c29627-e0f0-4fbf-9722-02460c78dee0', 'd479758f-f857-4fcb-b521-94dc144e8788', '5dbb20bb-a7a7-4070-9b26-394a6b5a2094', '1b5f5615-194d-432d-bcf0-711a12644495'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:02 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:34:02 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:02 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.247s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:34:02 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Deleted volume successfully. Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b2caccc9-c545-41c3-a36f-f2eed81d3544 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-cfbdd5f6-d26b-4765-9699-8618f087e2ac-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-45e6c7a9-32f3-4e91-85db-98990de78cbe-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-45e6c7a9-32f3-4e91-85db-98990de78cbe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-quobyte-45e6c7a9-32f3-4e91-85db-98990de78cbe" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-45e6c7a9-32f3-4e91-85db-98990de78cbe" acquired by "delete_volume" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7b9299-505d-4d18-a391-320b39c0bd48]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-45e6c7a9-32f3-4e91-85db-98990de78cbe {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:03 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-45e6c7a9-32f3-4e91-85db-98990de78cbe Sep 17 07:34:03 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:03 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-45e6c7a9-32f3-4e91-85db-98990de78cbe" returned: 0 in 0.393s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-45e6c7a9-32f3-4e91-85db-98990de78cbe {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:03 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-45e6c7a9-32f3-4e91-85db-98990de78cbe Sep 17 07:34:03 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:03 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-45e6c7a9-32f3-4e91-85db-98990de78cbe" returned: 0 in 0.250s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-45e6c7a9-32f3-4e91-85db-98990de78cbe" released by "delete_volume" :: held 0.691s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:03 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Created reservations ['eebccab3-cfdd-4719-b27d-1af45ba59992', 'c4da56cc-2153-42e7-bb7c-5762282c29dc', '05a1a52f-60da-43de-b8a0-cd9a5c7956ba', '766844ba-f7cd-4179-ac1b-35cd5c4cb6d1'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:03 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:34:03 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:03 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.262s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:03 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:34:03 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Deleted volume successfully. Sep 17 07:34:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-f004dd6f-3d46-48e5-83b8-e4e3fe4319c1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-45e6c7a9-32f3-4e91-85db-98990de78cbe-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-7881f5f4-b76d-480d-91b3-89c87c291f2f-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-7881f5f4-b76d-480d-91b3-89c87c291f2f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-quobyte-7881f5f4-b76d-480d-91b3-89c87c291f2f" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-7881f5f4-b76d-480d-91b3-89c87c291f2f" acquired by "delete_volume" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cea3c4-edd8-47e2-ab95-9aebc6bb649a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7881f5f4-b76d-480d-91b3-89c87c291f2f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:04 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7881f5f4-b76d-480d-91b3-89c87c291f2f Sep 17 07:34:04 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:04 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7881f5f4-b76d-480d-91b3-89c87c291f2f" returned: 0 in 0.358s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7881f5f4-b76d-480d-91b3-89c87c291f2f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:04 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7881f5f4-b76d-480d-91b3-89c87c291f2f Sep 17 07:34:04 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:04 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:34:04 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:04 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7881f5f4-b76d-480d-91b3-89c87c291f2f" returned: 0 in 0.257s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-7881f5f4-b76d-480d-91b3-89c87c291f2f" released by "delete_volume" :: held 0.655s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Created reservations ['8e1f6e05-1bb8-47af-be65-95a2a0433109', 'c8e914f7-3b5e-41af-8e78-48e2ec8587a1', '5c1bf40b-49ca-4e7a-b8d8-a36ab53fd25f', 'ea8c1458-d0ca-4e18-805d-6793374e296a'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:05 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.249s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:05 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:34:05 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:05 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.252s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:34:05 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Deleted volume successfully. Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4059173d-a723-4770-83f1-a198dc91705e tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-7881f5f4-b76d-480d-91b3-89c87c291f2f-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-2beecf0f-f5c7-42cb-a421-6dd2435e0213-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-2beecf0f-f5c7-42cb-a421-6dd2435e0213-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-quobyte-bf0fc9ed-879e-48c4-9f91-ca620b749bef" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-bf0fc9ed-879e-48c4-9f91-ca620b749bef" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-quobyte-2beecf0f-f5c7-42cb-a421-6dd2435e0213" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-2beecf0f-f5c7-42cb-a421-6dd2435e0213" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Deleting offline snapshot 2beecf0f-f5c7-42cb-a421-6dd2435e0213 of volume bf0fc9ed-879e-48c4-9f91-ca620b749bef {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] snapshot_file for this snap is: volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1b37ee-afec-45b0-a2df-ed547c8d8a99]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:05 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 Sep 17 07:34:05 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:05 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213" returned: 0 in 0.357s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[82df7c59-2775-494d-bf35-cf180ab6dfb6]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:05 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef Sep 17 07:34:05 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:06 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef" returned: 0 in 0.353s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:06 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 Sep 17 07:34:06 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:06 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213" returned: 0 in 0.328s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:06 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213 Sep 17 07:34:06 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:06 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef.2beecf0f-f5c7-42cb-a421-6dd2435e0213" returned: 0 in 0.246s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-2beecf0f-f5c7-42cb-a421-6dd2435e0213" released by "_delete_snapshot" :: held 1.394s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-bf0fc9ed-879e-48c4-9f91-ca620b749bef" released by "delete_snapshot" :: held 1.418s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:06 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Created reservations ['8d47c496-606f-419b-b2a9-3d013f4a9114', '4804b33c-bf0a-4fda-b98c-d230d9093a8a', '1010b519-d4fa-4dda-814a-e8965ba6311a', 'd3603ab2-a2a6-4f5f-aa78-1ae6708f1335'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:06 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Delete snapshot completed successfully. Sep 17 07:34:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8994e8d7-1fe3-4b24-af23-7994f9c593fd tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-2beecf0f-f5c7-42cb-a421-6dd2435e0213-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-bf0fc9ed-879e-48c4-9f91-ca620b749bef-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-bf0fc9ed-879e-48c4-9f91-ca620b749bef-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "cinder-quobyte-bf0fc9ed-879e-48c4-9f91-ca620b749bef" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-bf0fc9ed-879e-48c4-9f91-ca620b749bef" acquired by "delete_volume" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:07 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[07246f21-4e6b-4774-9df5-25b55b51e630]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:07 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef Sep 17 07:34:07 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:07 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef" returned: 0 in 0.363s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:08 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef Sep 17 07:34:08 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:08 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-bf0fc9ed-879e-48c4-9f91-ca620b749bef" returned: 0 in 0.247s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-quobyte-bf0fc9ed-879e-48c4-9f91-ca620b749bef" released by "delete_volume" :: held 0.676s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:08 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Created reservations ['59fc1c72-0eb4-4e2a-ad05-cf410b65bc0e', '1eec65f7-d0d5-4b60-9972-c1b14eec6d1f', 'd06f8b52-678c-4929-8a36-7b866162a71e', '39656da4-b65f-49b9-b31a-b15b6ededf56'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:08 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:34:08 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:08 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.250s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:08 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:34:08 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Deleted volume successfully. Sep 17 07:34:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b352969-eff7-457d-8d6d-299239e9a7d1 tempest-CreateVolumesFromSnapshotTest-1575329151 None] Lock "cinder-bf0fc9ed-879e-48c4-9f91-ca620b749bef-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:18 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=56,cinder:UPDATE=71,cinder:INSERT=18,cinder:DELETE=2 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:34:18 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=46,cinder:UPDATE=75,cinder:INSERT=17,cinder:DELETE=11 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:34:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-7b44807c-6d82-4877-9041-514b20423540 req-1f5e3ed3-180a-48e4-abd9-4889765a7d9f tempest-TestStampPattern-309290661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-7b44807c-6d82-4877-9041-514b20423540 req-1f5e3ed3-180a-48e4-abd9-4889765a7d9f tempest-TestStampPattern-309290661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [req-7b44807c-6d82-4877-9041-514b20423540 req-1f5e3ed3-180a-48e4-abd9-4889765a7d9f tempest-TestStampPattern-309290661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-7b44807c-6d82-4877-9041-514b20423540 req-1f5e3ed3-180a-48e4-abd9-4889765a7d9f tempest-TestStampPattern-309290661 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57', 'name': 'volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'baa5d7e7-7c01-4901-bfce-1ca95ae2565d', 'enforce_multipath': True} {{(pid=86029) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 07:34:19 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-7b44807c-6d82-4877-9041-514b20423540 req-1f5e3ed3-180a-48e4-abd9-4889765a7d9f tempest-TestStampPattern-309290661 None] attachment_update completed successfully. Sep 17 07:34:22 devstack cinder-volume[86029]: INFO cinder.volume.manager [req-c657d222-5ca1-46db-a842-fc31dfcfa22d req-f7305d25-730e-4f8b-9e4c-b48bfc3aeac3 tempest-TestStampPattern-309290661 None] Terminate volume connection completed successfully. Sep 17 07:34:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [req-c657d222-5ca1-46db-a842-fc31dfcfa22d req-f7305d25-730e-4f8b-9e4c-b48bfc3aeac3 tempest-TestStampPattern-309290661 None] Deleting attachment baa5d7e7-7c01-4901-bfce-1ca95ae2565d. {{(pid=86029) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 07:34:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Acquiring lock "cinder-7df40a49-8445-44cd-ae2c-b19d8571a3e3-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Lock "cinder-7df40a49-8445-44cd-ae2c-b19d8571a3e3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Acquiring lock "cinder-quobyte-7df40a49-8445-44cd-ae2c-b19d8571a3e3" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Lock "cinder-quobyte-7df40a49-8445-44cd-ae2c-b19d8571a3e3" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:27 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb63a861-f8bc-4805-a5f7-e77cd4fad432]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:27 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3 Sep 17 07:34:27 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:28 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3" returned: 0 in 0.366s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:28 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3 Sep 17 07:34:28 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:28 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7df40a49-8445-44cd-ae2c-b19d8571a3e3" returned: 0 in 0.288s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Lock "cinder-quobyte-7df40a49-8445-44cd-ae2c-b19d8571a3e3" released by "delete_volume" :: held 0.717s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:28 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Created reservations ['2c855bcb-b3fb-44e6-a4e2-f93e0bd11ffb', 'bb1589a8-b7fd-4ef7-8a68-1d0db1f58963', 'b3442493-439f-444d-9a94-b034674b1075', '394d85fc-80eb-4b7f-ba4a-5ebffdbc37d9'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:28 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:34:28 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:29 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.319s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:34:29 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Deleted volume successfully. Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-851a30d4-6a50-46bd-aa66-f5012cb4c7f5 tempest-TestStampPattern-309290661 None] Lock "cinder-7df40a49-8445-44cd-ae2c-b19d8571a3e3-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Acquiring lock "cinder-20cf703b-2d41-4b25-8e22-38972bf63971-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Lock "cinder-20cf703b-2d41-4b25-8e22-38972bf63971-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Acquiring lock "cinder-quobyte-01a537fe-f2ca-456f-ace1-221e24aec9c7" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Lock "cinder-quobyte-01a537fe-f2ca-456f-ace1-221e24aec9c7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Acquiring lock "cinder-quobyte-20cf703b-2d41-4b25-8e22-38972bf63971" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Lock "cinder-quobyte-20cf703b-2d41-4b25-8e22-38972bf63971" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Deleting offline snapshot 20cf703b-2d41-4b25-8e22-38972bf63971 of volume 01a537fe-f2ca-456f-ace1-221e24aec9c7 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] snapshot_file for this snap is: volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d6fcf5-e0a8-4782-9466-c2b6e0950da3]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:29 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 Sep 17 07:34:29 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:29 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Flow 'volume_create_manager' (f79fe38f-1ef7-4c5b-a321-ee553e42272f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71fac9a-55d6-4f05-819a-e47cfd8f1ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971" returned: 0 in 0.446s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01a537fe-f2ca-456f-ace1-221e24aec9c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71fac9a-55d6-4f05-819a-e47cfd8f1ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1449561203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca73742-f103-48c8-9fa9-84f8c79272d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb86e6d4626a4cff8d2fb384aa45d317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:34:30Z,use_quota=True,user_id='91aada9dac484168bf4657ca1cbfaa7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68a052e-8d4e-4998-bcaa-9bf3ff5818d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68a052e-8d4e-4998-bcaa-9bf3ff5818d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdeb1d9-4d2f-426a-b2de-a739459b66de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdeb1d9-4d2f-426a-b2de-a739459b66de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eca73742-f103-48c8-9fa9-84f8c79272d5', 'volume_name': 'volume-eca73742-f103-48c8-9fa9-84f8c79272d5', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382e8ba7-036c-4510-8846-004c6e08b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382e8ba7-036c-4510-8846-004c6e08b490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b419d7-b2f0-41b8-9251-9ad8bcc83807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:29 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Volume eca73742-f103-48c8-9fa9-84f8c79272d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eca73742-f103-48c8-9fa9-84f8c79272d5', 'volume_size': 1} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1449561203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca73742-f103-48c8-9fa9-84f8c79272d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb86e6d4626a4cff8d2fb384aa45d317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:34:30Z,use_quota=True,user_id='91aada9dac484168bf4657ca1cbfaa7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Creating volume eca73742-f103-48c8-9fa9-84f8c79272d5 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:34:29 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce7662c-d666-41ab-b21d-6f67680c8f14]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:29 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 1073741824 Sep 17 07:34:29 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:29 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 Sep 17 07:34:29 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:30 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 1073741824" returned: 0 in 0.406s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:30 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 Sep 17 07:34:30 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:30 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7" returned: 0 in 0.566s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:30 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 Sep 17 07:34:30 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:30 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5" returned: 0 in 0.255s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:30 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:34:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b419d7-b2f0-41b8-9251-9ad8bcc83807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eca73742-f103-48c8-9fa9-84f8c79272d5', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f606f3aa-34fb-4cb3-82fa-db3f8739924d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:30 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Volume volume-eca73742-f103-48c8-9fa9-84f8c79272d5 (eca73742-f103-48c8-9fa9-84f8c79272d5): created successfully Sep 17 07:34:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f606f3aa-34fb-4cb3-82fa-db3f8739924d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:30 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Flow 'volume_create_manager' (f79fe38f-1ef7-4c5b-a321-ee553e42272f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:34:30 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-c8055bab-a6e7-42e0-9c7b-ce0a14555ef2 tempest-SnapshotDependencyTests-1702193153 None] Created volume successfully. Sep 17 07:34:30 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971" returned: 0 in 0.381s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:30 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971 Sep 17 07:34:30 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] Creating offline snapshot ca92a591-e9b7-4a58-8ea3-3a809c2c2628 of volume eca73742-f103-48c8-9fa9-84f8c79272d5 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:34:31 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1849d5d-43a8-42e4-803a-ffa43e389b16]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:31 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7.20cf703b-2d41-4b25-8e22-38972bf63971" returned: 0 in 0.260s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Lock "cinder-quobyte-20cf703b-2d41-4b25-8e22-38972bf63971" released by "_delete_snapshot" :: held 1.824s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Lock "cinder-quobyte-01a537fe-f2ca-456f-ace1-221e24aec9c7" released by "delete_snapshot" :: held 1.845s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:31 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 Sep 17 07:34:31 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:31 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Created reservations ['7baa8eaf-b741-4030-8b8d-b1b31783e403', 'bbc993c1-fea8-4dc5-988b-ab35b048c8c3', '0eedc65c-3cc6-43e3-a1ac-e4e4426833df', '036ffcc9-6c56-4117-ad88-97899ebd0508'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:31 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Delete snapshot completed successfully. Sep 17 07:34:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-810f6f6f-827b-4f04-a4e0-565f04ed0553 tempest-TestStampPattern-309290661 None] Lock "cinder-20cf703b-2d41-4b25-8e22-38972bf63971-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:31 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5" returned: 0 in 0.372s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:31 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 1G Sep 17 07:34:31 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:31 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 1G" returned: 0 in 0.416s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eca73742-f103-48c8-9fa9-84f8c79272d5 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:31 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eca73742-f103-48c8-9fa9-84f8c79272d5 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 Sep 17 07:34:31 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:32 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eca73742-f103-48c8-9fa9-84f8c79272d5 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628" returned: 0 in 0.323s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:32 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 is being set with open permissions: ugo+rw Sep 17 07:34:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:32 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 Sep 17 07:34:32 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:32 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628" returned: 0 in 0.273s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:32 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.info Sep 17 07:34:32 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:32 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.info" returned: 0 in 0.340s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:32 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.info is being set with open permissions: ugo+rw Sep 17 07:34:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:32 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.info Sep 17 07:34:32 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:33 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.info" returned: 0 in 0.344s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:33 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-9e68d295-17e1-4f0b-999b-ababf694e76d tempest-SnapshotDependencyTests-1702193153 None] Create snapshot completed successfully Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Flow 'volume_create_manager' (6001ac77-93a3-459f-a808-b3d351d004e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a35a1c-e7ff-478d-a3cd-41af3706ff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a35a1c-e7ff-478d-a3cd-41af3706ff41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e41b07c-d528-44da-84f0-3350b417fda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb86e6d4626a4cff8d2fb384aa45d317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ca92a591-e9b7-4a58-8ea3-3a809c2c2628,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:34:35Z,use_quota=True,user_id='91aada9dac484168bf4657ca1cbfaa7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87611b6f-99cf-4c90-960e-0fd054515ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87611b6f-99cf-4c90-960e-0fd054515ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b24e70-0f50-457a-9e7b-fb41a4b051fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b24e70-0f50-457a-9e7b-fb41a4b051fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8e41b07c-d528-44da-84f0-3350b417fda6', 'volume_name': 'volume-8e41b07c-d528-44da-84f0-3350b417fda6', 'volume_size': 1, 'snapshot_id': 'ca92a591-e9b7-4a58-8ea3-3a809c2c2628'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92395a5-8100-43d1-a82b-27dfdd846765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92395a5-8100-43d1-a82b-27dfdd846765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a37d68e-c528-4a9d-ba09-b70cea9b225e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:34 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Volume 8e41b07c-d528-44da-84f0-3350b417fda6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8e41b07c-d528-44da-84f0-3350b417fda6', 'volume_size': 1, 'snapshot_id': 'ca92a591-e9b7-4a58-8ea3-3a809c2c2628'} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "cinder-quobyte-ca92a591-e9b7-4a58-8ea3-3a809c2c2628-8e41b07c-d528-44da-84f0-3350b417fda6" by "_create_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-quobyte-ca92a591-e9b7-4a58-8ea3-3a809c2c2628-8e41b07c-d528-44da-84f0-3350b417fda6" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Creating volume 8e41b07c-d528-44da-84f0-3350b417fda6 from snapshot ca92a591-e9b7-4a58-8ea3-3a809c2c2628 {{(pid=86029) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "cinder-quobyte-8e41b07c-d528-44da-84f0-3350b417fda6" by "_copy_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-quobyte-8e41b07c-d528-44da-84f0-3350b417fda6" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] snapshot: ca92a591-e9b7-4a58-8ea3-3a809c2c2628, volume: 8e41b07c-d528-44da-84f0-3350b417fda6, {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:34 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb651fd7-e6a7-4e9f-8c56-cf7563e66802]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:35 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 Sep 17 07:34:35 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Acquiring lock "cinder-01a537fe-f2ca-456f-ace1-221e24aec9c7-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Lock "cinder-01a537fe-f2ca-456f-ace1-221e24aec9c7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Acquiring lock "cinder-quobyte-01a537fe-f2ca-456f-ace1-221e24aec9c7" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Lock "cinder-quobyte-01a537fe-f2ca-456f-ace1-221e24aec9c7" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5b21d2-06fa-4ce1-b728-20b082ad6592]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:35 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 Sep 17 07:34:35 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:35 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628" returned: 0 in 0.365s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eca73742-f103-48c8-9fa9-84f8c79272d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc37aece-3e7a-4696-b756-15e6e1bcb7d9]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:35 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 Sep 17 07:34:35 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:35 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7" returned: 0 in 0.358s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:35 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7 Sep 17 07:34:35 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:35 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5" returned: 0 in 0.357s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] will copy from snapshot at /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Creating direct copy from snapshot {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG cinder.utils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Path /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6 not found in is_blk_device check {{(pid=86029) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:35 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6 Sep 17 07:34:35 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:35 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01a537fe-f2ca-456f-ace1-221e24aec9c7" returned: 0 in 0.260s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Lock "cinder-quobyte-01a537fe-f2ca-456f-ace1-221e24aec9c7" released by "delete_volume" :: held 0.678s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Created reservations ['3d065f6d-8d9e-4b6a-89a8-72baa1bed52f', '13db8c58-31a2-4f32-873b-c0265925c079', '54d557fe-6adf-4307-82ac-401562eccaec', '8931db64-0249-4853-8a9e-7e7598946f9b'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:35 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:36 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:34:36 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:36 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.291s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:36 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:34:36 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Deleted volume successfully. Sep 17 07:34:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dfe2842a-ec75-4166-a41e-e38e2e27fd11 tempest-TestStampPattern-309290661 None] Lock "cinder-01a537fe-f2ca-456f-ace1-221e24aec9c7-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:42 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6" returned: 0 in 6.848s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:42 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:34:42 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Converted 1024.00 MB image at 149.51 MB/s Sep 17 07:34:42 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6 is being set with open permissions: ugo+rw Sep 17 07:34:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:42 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6 Sep 17 07:34:42 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:42 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6" returned: 0 in 0.300s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:42 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-quobyte-8e41b07c-d528-44da-84f0-3350b417fda6" released by "_copy_volume_from_snapshot" :: held 7.952s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:42 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-quobyte-ca92a591-e9b7-4a58-8ea3-3a809c2c2628-8e41b07c-d528-44da-84f0-3350b417fda6" released by "_create_volume_from_snapshot" :: held 8.013s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.028s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a37d68e-c528-4a9d-ba09-b70cea9b225e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e41b07c-d528-44da-84f0-3350b417fda6', 'volume_size': 1, 'snapshot_id': 'ca92a591-e9b7-4a58-8ea3-3a809c2c2628'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdd36ef-3289-4b78-b9ef-c46aba52cc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:42 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Volume volume-8e41b07c-d528-44da-84f0-3350b417fda6 (8e41b07c-d528-44da-84f0-3350b417fda6): created successfully Sep 17 07:34:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdd36ef-3289-4b78-b9ef-c46aba52cc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Flow 'volume_create_manager' (6001ac77-93a3-459f-a808-b3d351d004e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:34:43 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0dd94194-b96b-480b-9f51-4ec1f50a0f4a tempest-SnapshotDependencyTests-1702193153 None] Created volume successfully. Sep 17 07:34:43 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "cinder-ca92a591-e9b7-4a58-8ea3-3a809c2c2628-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:43 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-ca92a591-e9b7-4a58-8ea3-3a809c2c2628-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:43 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "cinder-quobyte-eca73742-f103-48c8-9fa9-84f8c79272d5" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:43 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-quobyte-eca73742-f103-48c8-9fa9-84f8c79272d5" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:43 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "cinder-quobyte-ca92a591-e9b7-4a58-8ea3-3a809c2c2628" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:43 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-quobyte-ca92a591-e9b7-4a58-8ea3-3a809c2c2628" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Deleting offline snapshot ca92a591-e9b7-4a58-8ea3-3a809c2c2628 of volume eca73742-f103-48c8-9fa9-84f8c79272d5 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:34:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] snapshot_file for this snap is: volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:34:43 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4131db-8eac-4bc4-ba25-3d3982a45aa6]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:43 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 Sep 17 07:34:43 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:44 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628" returned: 0 in 0.373s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eca73742-f103-48c8-9fa9-84f8c79272d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:34:44 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f46112-71d3-4337-b014-197e14afe567]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:44 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 Sep 17 07:34:44 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:44 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5" returned: 0 in 0.583s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:44 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 Sep 17 07:34:44 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:45 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628" returned: 0 in 0.326s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:45 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628 Sep 17 07:34:45 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:45 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5.ca92a591-e9b7-4a58-8ea3-3a809c2c2628" returned: 0 in 0.265s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-quobyte-ca92a591-e9b7-4a58-8ea3-3a809c2c2628" released by "_delete_snapshot" :: held 1.688s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-quobyte-eca73742-f103-48c8-9fa9-84f8c79272d5" released by "delete_snapshot" :: held 1.717s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:45 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Created reservations ['704b065b-dacb-45f0-939e-ea1154563b45', '8e42c476-7020-4b6b-b642-c1428b674aa4', '08a82321-61c5-487f-ae91-88661b6a183d', 'b89ad1df-2dc2-420e-b8f6-f26fed952b94'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:45 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Delete snapshot completed successfully. Sep 17 07:34:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-acb5503f-407c-41d4-819a-0b36d58f52ed tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-ca92a591-e9b7-4a58-8ea3-3a809c2c2628-delete_snapshot" released by "delete_snapshot" :: held 1.867s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "cinder-eca73742-f103-48c8-9fa9-84f8c79272d5-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-eca73742-f103-48c8-9fa9-84f8c79272d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "cinder-quobyte-eca73742-f103-48c8-9fa9-84f8c79272d5" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:45 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-quobyte-eca73742-f103-48c8-9fa9-84f8c79272d5" acquired by "delete_volume" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:45 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bd1106-0372-4110-b15d-9001aefe4e94]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:46 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 Sep 17 07:34:46 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:46 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5" returned: 0 in 0.376s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:46 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5 Sep 17 07:34:46 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:46 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-eca73742-f103-48c8-9fa9-84f8c79272d5" returned: 0 in 0.241s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-quobyte-eca73742-f103-48c8-9fa9-84f8c79272d5" released by "delete_volume" :: held 0.684s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Created reservations ['8b92d8f6-ba9f-4164-a73d-e8292cf2ba4b', '4e98c5ea-c34f-4815-a127-2052a9f9b75b', 'b2e08c35-ea12-403d-b808-41db4a497149', '77d34526-0f20-4665-b5db-dca7f0cf21d6'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:46 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:34:46 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:46 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.264s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:34:46 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Deleted volume successfully. Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-07b6d834-45e4-41b7-953a-7eedd7d30939 tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-eca73742-f103-48c8-9fa9-84f8c79272d5-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "cinder-8e41b07c-d528-44da-84f0-3350b417fda6-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-8e41b07c-d528-44da-84f0-3350b417fda6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "cinder-quobyte-8e41b07c-d528-44da-84f0-3350b417fda6" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-quobyte-8e41b07c-d528-44da-84f0-3350b417fda6" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf59c360-1e6c-4dad-979c-7d6abb0b19e6]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:47 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6 Sep 17 07:34:47 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:47 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6" returned: 0 in 0.396s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:47 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6 Sep 17 07:34:47 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:47 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8e41b07c-d528-44da-84f0-3350b417fda6" returned: 0 in 0.267s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-quobyte-8e41b07c-d528-44da-84f0-3350b417fda6" released by "delete_volume" :: held 0.762s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Created reservations ['a797c320-aeff-4f58-b6d6-187a8f38cdf8', '975a5357-337d-4207-be8e-ed34f5958b80', 'be076ae0-6a8a-4304-9f0c-0a171f4419d3', '88e0d97a-a065-4d21-b074-cbf0c6f88454'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:47 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:34:47 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:48 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.290s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:48 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:34:48 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Deleted volume successfully. Sep 17 07:34:48 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-249d65fe-744e-4497-949f-59af13e017b3 tempest-SnapshotDependencyTests-1702193153 None] Lock "cinder-8e41b07c-d528-44da-84f0-3350b417fda6-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Flow 'volume_create_manager' (1a11f491-ac55-4cca-9a41-81bc82df6ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8579ab5a-1c50-412f-a9bb-cb4e3a18e9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8579ab5a-1c50-412f-a9bb-cb4e3a18e9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-933050606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d58a312-93c5-4a5f-8068-987dcfeb49bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300457048eee457ca3c38cade1b61187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:34:51Z,use_quota=True,user_id='5f51bb47bde1480d806e4f61ed2403e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ae5845-a0f8-4135-bbc9-e23155e5699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ae5845-a0f8-4135-bbc9-e23155e5699e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb48854b-a4c2-4cab-a287-fc59338aecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb48854b-a4c2-4cab-a287-fc59338aecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d58a312-93c5-4a5f-8068-987dcfeb49bc', 'volume_name': 'volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad2bccd-0891-4150-8748-ef89ac0fd460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad2bccd-0891-4150-8748-ef89ac0fd460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b561c01-5955-42a1-a2c9-7eb5ae02dda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:51 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Volume 4d58a312-93c5-4a5f-8068-987dcfeb49bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc', 'volume_size': 1} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-933050606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d58a312-93c5-4a5f-8068-987dcfeb49bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300457048eee457ca3c38cade1b61187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:34:51Z,use_quota=True,user_id='5f51bb47bde1480d806e4f61ed2403e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Creating volume 4d58a312-93c5-4a5f-8068-987dcfeb49bc {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:34:51 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:51 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc 1073741824 Sep 17 07:34:51 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Flow 'volume_create_manager' (f1f23aae-b877-43f3-b106-e28dec3290fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f16680-fa33-44e4-92e2-b6e3f216b92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f16680-fa33-44e4-92e2-b6e3f216b92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1133460248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2fd72a-0560-48cb-9681-34a400385967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300457048eee457ca3c38cade1b61187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:34:52Z,use_quota=True,user_id='5f51bb47bde1480d806e4f61ed2403e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e861fdee-d66c-4a6b-9a1f-d4be91e64bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e861fdee-d66c-4a6b-9a1f-d4be91e64bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e465231-5d9c-42f0-b39d-dbdf0fd683e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e465231-5d9c-42f0-b39d-dbdf0fd683e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2fd72a-0560-48cb-9681-34a400385967', 'volume_name': 'volume-7f2fd72a-0560-48cb-9681-34a400385967', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:51 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485e1aaf-e137-42da-a668-e959d28ec27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485e1aaf-e137-42da-a668-e959d28ec27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeee8aa4-abde-40c7-9ed6-f6a9a95eb93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:52 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Volume 7f2fd72a-0560-48cb-9681-34a400385967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2fd72a-0560-48cb-9681-34a400385967', 'volume_size': 1} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:52 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc 1073741824" returned: 0 in 0.518s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:52 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc Sep 17 07:34:52 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Flow 'volume_create_manager' (33eecf17-5f2c-4d03-96b1-c13dc2b846e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e27b21-a061-4f3f-9fb0-afd18f08b023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e27b21-a061-4f3f-9fb0-afd18f08b023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-208124003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300457048eee457ca3c38cade1b61187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:34:52Z,use_quota=True,user_id='5f51bb47bde1480d806e4f61ed2403e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6b1b78-751c-4dec-8129-7ca0207ca710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6b1b78-751c-4dec-8129-7ca0207ca710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86c2522-b765-4735-bd88-418a2a264f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86c2522-b765-4735-bd88-418a2a264f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2', 'volume_name': 'volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e0813a-9c4e-4d00-b1dc-2987f93f4e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e0813a-9c4e-4d00-b1dc-2987f93f4e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a3ddf4-b81e-4dfd-aeb9-a01a0d8a53ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:52 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Volume cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2', 'volume_size': 1} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:52 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc" returned: 0 in 0.546s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1133460248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2fd72a-0560-48cb-9681-34a400385967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300457048eee457ca3c38cade1b61187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:34:52Z,use_quota=True,user_id='5f51bb47bde1480d806e4f61ed2403e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Creating volume 7f2fd72a-0560-48cb-9681-34a400385967 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:34:52 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7f2fd72a-0560-48cb-9681-34a400385967 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b561c01-5955-42a1-a2c9-7eb5ae02dda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33203ee6-1739-4be7-8e10-fe203bfa02f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:52 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7f2fd72a-0560-48cb-9681-34a400385967 1073741824 Sep 17 07:34:52 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:52 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Volume volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc (4d58a312-93c5-4a5f-8068-987dcfeb49bc): created successfully Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33203ee6-1739-4be7-8e10-fe203bfa02f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Flow 'volume_create_manager' (1a11f491-ac55-4cca-9a41-81bc82df6ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:34:52 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cf83e0de-cb0d-46fe-a5c8-935cc8b6519b tempest-CreateVolumesFromImageTest-1800126068 None] Created volume successfully. Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Flow 'volume_create_manager' (a70fd3d4-ea3a-47a9-98bc-ff40a58e1123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d54e481-0e5c-4ab7-83e9-3e1be7aa2f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d54e481-0e5c-4ab7-83e9-3e1be7aa2f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2003874465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996d8804-f77b-46d0-8575-52978ac3dd69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300457048eee457ca3c38cade1b61187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:34:53Z,use_quota=True,user_id='5f51bb47bde1480d806e4f61ed2403e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357830fa-1073-4acf-8cfd-aa46e3e4f5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357830fa-1073-4acf-8cfd-aa46e3e4f5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aec8596-e905-411a-8902-66ad38da7ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aec8596-e905-411a-8902-66ad38da7ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '996d8804-f77b-46d0-8575-52978ac3dd69', 'volume_name': 'volume-996d8804-f77b-46d0-8575-52978ac3dd69', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13494fa2-c91b-4e0c-a0be-4013512d08a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13494fa2-c91b-4e0c-a0be-4013512d08a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69f2d58-4af3-438a-aa3c-09ee1ac827d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:53 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Volume 996d8804-f77b-46d0-8575-52978ac3dd69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-996d8804-f77b-46d0-8575-52978ac3dd69', 'volume_size': 1} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:53 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7f2fd72a-0560-48cb-9681-34a400385967 1073741824" returned: 0 in 0.587s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7f2fd72a-0560-48cb-9681-34a400385967 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:53 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7f2fd72a-0560-48cb-9681-34a400385967 Sep 17 07:34:53 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Flow 'volume_create_manager' (f5fdcddb-75ab-44a7-8372-d68074b23b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eaf7cc5-7f97-4afb-8e6c-ad11a2cd0351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eaf7cc5-7f97-4afb-8e6c-ad11a2cd0351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2134876115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee684c9e-837b-43cc-9695-a9bd0016ec04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300457048eee457ca3c38cade1b61187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:34:53Z,use_quota=True,user_id='5f51bb47bde1480d806e4f61ed2403e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934cf0af-16ee-4eac-b9dd-48ba31233eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934cf0af-16ee-4eac-b9dd-48ba31233eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb773c8b-7fb6-4bcc-888d-e60a52c4006f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb773c8b-7fb6-4bcc-888d-e60a52c4006f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee684c9e-837b-43cc-9695-a9bd0016ec04', 'volume_name': 'volume-ee684c9e-837b-43cc-9695-a9bd0016ec04', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29877d86-52bc-4110-b802-1ca5dbcc4de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29877d86-52bc-4110-b802-1ca5dbcc4de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb844d5-b33f-4fc0-987d-a547c8eb58d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:53 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Volume ee684c9e-837b-43cc-9695-a9bd0016ec04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee684c9e-837b-43cc-9695-a9bd0016ec04', 'volume_size': 1} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:53 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7f2fd72a-0560-48cb-9681-34a400385967" returned: 0 in 0.292s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.992s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-208124003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300457048eee457ca3c38cade1b61187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:34:52Z,use_quota=True,user_id='5f51bb47bde1480d806e4f61ed2403e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Creating volume cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:34:53 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:53 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2 1073741824 Sep 17 07:34:53 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeee8aa4-abde-40c7-9ed6-f6a9a95eb93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2fd72a-0560-48cb-9681-34a400385967', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d053bb4-f815-46eb-a32f-1aab78ce7abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:53 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Volume volume-7f2fd72a-0560-48cb-9681-34a400385967 (7f2fd72a-0560-48cb-9681-34a400385967): created successfully Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d053bb4-f815-46eb-a32f-1aab78ce7abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Flow 'volume_create_manager' (f1f23aae-b877-43f3-b106-e28dec3290fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:34:53 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-16a2d0d2-1958-4515-9703-173d66a869a1 tempest-CreateVolumesFromImageTest-1800126068 None] Created volume successfully. Sep 17 07:34:54 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2 1073741824" returned: 0 in 0.477s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:54 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2 Sep 17 07:34:54 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:54 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2" returned: 0 in 0.263s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.427s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2003874465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996d8804-f77b-46d0-8575-52978ac3dd69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300457048eee457ca3c38cade1b61187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:34:53Z,use_quota=True,user_id='5f51bb47bde1480d806e4f61ed2403e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Creating volume 996d8804-f77b-46d0-8575-52978ac3dd69 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:34:54 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-996d8804-f77b-46d0-8575-52978ac3dd69 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a3ddf4-b81e-4dfd-aeb9-a01a0d8a53ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:54 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-996d8804-f77b-46d0-8575-52978ac3dd69 1073741824 Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de0cfa1-36a9-4294-92b3-75bc8d73217d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:54 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:54 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Volume volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2 (cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2): created successfully Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de0cfa1-36a9-4294-92b3-75bc8d73217d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Flow 'volume_create_manager' (33eecf17-5f2c-4d03-96b1-c13dc2b846e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:34:54 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-bb797b57-3ff2-4aa5-b705-7220d40a73ad tempest-CreateVolumesFromImageTest-1800126068 None] Created volume successfully. Sep 17 07:34:54 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-996d8804-f77b-46d0-8575-52978ac3dd69 1073741824" returned: 0 in 0.479s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-996d8804-f77b-46d0-8575-52978ac3dd69 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:55 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-996d8804-f77b-46d0-8575-52978ac3dd69 Sep 17 07:34:55 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:55 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-996d8804-f77b-46d0-8575-52978ac3dd69" returned: 0 in 0.254s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.711s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2134876115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee684c9e-837b-43cc-9695-a9bd0016ec04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300457048eee457ca3c38cade1b61187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:34:53Z,use_quota=True,user_id='5f51bb47bde1480d806e4f61ed2403e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Creating volume ee684c9e-837b-43cc-9695-a9bd0016ec04 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:34:55 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee684c9e-837b-43cc-9695-a9bd0016ec04 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69f2d58-4af3-438a-aa3c-09ee1ac827d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-996d8804-f77b-46d0-8575-52978ac3dd69', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:55 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee684c9e-837b-43cc-9695-a9bd0016ec04 1073741824 Sep 17 07:34:55 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (159bac79-43e5-4961-bc5f-914dcc80e690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:55 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Volume volume-996d8804-f77b-46d0-8575-52978ac3dd69 (996d8804-f77b-46d0-8575-52978ac3dd69): created successfully Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (159bac79-43e5-4961-bc5f-914dcc80e690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Flow 'volume_create_manager' (a70fd3d4-ea3a-47a9-98bc-ff40a58e1123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:34:55 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-da5ebfd8-e79b-4b93-aef6-daaaf39b9f78 tempest-CreateVolumesFromImageTest-1800126068 None] Created volume successfully. Sep 17 07:34:55 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee684c9e-837b-43cc-9695-a9bd0016ec04 1073741824" returned: 0 in 0.486s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee684c9e-837b-43cc-9695-a9bd0016ec04 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:55 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee684c9e-837b-43cc-9695-a9bd0016ec04 Sep 17 07:34:55 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:56 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee684c9e-837b-43cc-9695-a9bd0016ec04" returned: 0 in 0.252s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:34:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb844d5-b33f-4fc0-987d-a547c8eb58d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee684c9e-837b-43cc-9695-a9bd0016ec04', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c4b080-aaf4-4f81-af21-f7355c334abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:34:56 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Volume volume-ee684c9e-837b-43cc-9695-a9bd0016ec04 (ee684c9e-837b-43cc-9695-a9bd0016ec04): created successfully Sep 17 07:34:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c4b080-aaf4-4f81-af21-f7355c334abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:34:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Flow 'volume_create_manager' (f5fdcddb-75ab-44a7-8372-d68074b23b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:34:56 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-24e7b20a-3523-4581-a0d2-bb85b73f9604 tempest-CreateVolumesFromImageTest-1800126068 None] Created volume successfully. Sep 17 07:34:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "cinder-ee684c9e-837b-43cc-9695-a9bd0016ec04-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-ee684c9e-837b-43cc-9695-a9bd0016ec04-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "cinder-quobyte-ee684c9e-837b-43cc-9695-a9bd0016ec04" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-quobyte-ee684c9e-837b-43cc-9695-a9bd0016ec04" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:56 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[331c0ee4-f96e-4e6e-988b-7e315b31ad2c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee684c9e-837b-43cc-9695-a9bd0016ec04 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:57 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee684c9e-837b-43cc-9695-a9bd0016ec04 Sep 17 07:34:57 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:57 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee684c9e-837b-43cc-9695-a9bd0016ec04" returned: 0 in 0.409s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee684c9e-837b-43cc-9695-a9bd0016ec04 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:57 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee684c9e-837b-43cc-9695-a9bd0016ec04 Sep 17 07:34:57 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:57 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee684c9e-837b-43cc-9695-a9bd0016ec04" returned: 0 in 0.275s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-quobyte-ee684c9e-837b-43cc-9695-a9bd0016ec04" released by "delete_volume" :: held 0.727s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:57 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Created reservations ['fe1165c9-8130-4777-abf5-234dc55b55d6', 'a56e1bb2-3e33-44ff-bf8a-fc758aaa504a', '53d3adf9-3b57-44be-a998-df0ac784cb6c', '2df0ac5e-3e2e-489f-8b0a-48cc186560f3'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:57 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:34:57 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "cinder-996d8804-f77b-46d0-8575-52978ac3dd69-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-996d8804-f77b-46d0-8575-52978ac3dd69-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:58 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.328s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:58 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:34:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Deleted volume successfully. Sep 17 07:34:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "cinder-quobyte-996d8804-f77b-46d0-8575-52978ac3dd69" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-af9d9c2e-f10d-496e-b246-6c6ae7a76ee9 tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-ee684c9e-837b-43cc-9695-a9bd0016ec04-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-quobyte-996d8804-f77b-46d0-8575-52978ac3dd69" acquired by "delete_volume" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:58 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceda5d3-a027-4cf4-b2b0-42852998632b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-996d8804-f77b-46d0-8575-52978ac3dd69 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:58 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-996d8804-f77b-46d0-8575-52978ac3dd69 Sep 17 07:34:58 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:58 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-996d8804-f77b-46d0-8575-52978ac3dd69" returned: 0 in 0.391s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-996d8804-f77b-46d0-8575-52978ac3dd69 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:58 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-996d8804-f77b-46d0-8575-52978ac3dd69 Sep 17 07:34:58 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:58 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-996d8804-f77b-46d0-8575-52978ac3dd69" returned: 0 in 0.278s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-quobyte-996d8804-f77b-46d0-8575-52978ac3dd69" released by "delete_volume" :: held 0.722s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:58 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Created reservations ['fa0e0a5a-f594-4e2d-92d3-4638a3a85020', '894fa312-1be9-48a7-9916-bb145ae1085f', '22bbc16e-f1aa-47c5-85b2-31c470cfe6fb', 'ab166500-f904-436d-ac3e-2273dc483b62'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:59 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:34:59 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "cinder-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:59 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.266s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:34:59 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Deleted volume successfully. Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-99ec0fb5-394a-4f30-8d16-2c449e6d515f tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-996d8804-f77b-46d0-8575-52978ac3dd69-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "cinder-quobyte-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-quobyte-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[14467ea4-cfa9-4937-88a4-b28371262483]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:59 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2 Sep 17 07:34:59 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:34:59 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2" returned: 0 in 0.401s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:34:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:34:59 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2 Sep 17 07:34:59 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:00 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2" returned: 0 in 0.262s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-quobyte-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2" released by "delete_volume" :: held 0.712s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Created reservations ['c9caefcf-5e3c-4d1e-ad7b-a9ad5bf49e82', '64ce4310-6a09-4bc1-a279-7d1d90210f54', 'e0d9bb09-bdef-451c-89fe-a456ce496508', '92b15943-1546-4ee4-a48d-5efe544b45a2'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:00 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:00 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "cinder-7f2fd72a-0560-48cb-9681-34a400385967-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:00 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-7f2fd72a-0560-48cb-9681-34a400385967-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.272s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Deleted volume successfully. Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-43c9e5bd-0652-497d-87af-ae1fa347f46a tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-cc1f5b31-30ea-4d5a-ac38-d5c35acdc1b2-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "cinder-quobyte-7f2fd72a-0560-48cb-9681-34a400385967" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-quobyte-7f2fd72a-0560-48cb-9681-34a400385967" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[045db103-f134-4392-9e5c-cbda1b6c2740]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7f2fd72a-0560-48cb-9681-34a400385967 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:00 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7f2fd72a-0560-48cb-9681-34a400385967 Sep 17 07:35:00 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:00 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7f2fd72a-0560-48cb-9681-34a400385967" returned: 0 in 0.370s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7f2fd72a-0560-48cb-9681-34a400385967 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:00 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7f2fd72a-0560-48cb-9681-34a400385967 Sep 17 07:35:00 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:01 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7f2fd72a-0560-48cb-9681-34a400385967" returned: 0 in 0.252s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-quobyte-7f2fd72a-0560-48cb-9681-34a400385967" released by "delete_volume" :: held 0.661s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Created reservations ['e3713d79-e92d-46d3-b7c3-e4494c3fa2a2', 'b5e85684-0748-4b35-8267-cf3e847e0c1b', 'b24f197b-48d7-4fed-be2a-47d6d4f76e67', 'cb9a224b-fec4-412c-91e1-2fbccf799005'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:01 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:01 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:01 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.253s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Deleted volume successfully. Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4161f610-4883-4edb-82c5-9a3212d67fca tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-7f2fd72a-0560-48cb-9681-34a400385967-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "cinder-4d58a312-93c5-4a5f-8068-987dcfeb49bc-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-4d58a312-93c5-4a5f-8068-987dcfeb49bc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "cinder-quobyte-4d58a312-93c5-4a5f-8068-987dcfeb49bc" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-quobyte-4d58a312-93c5-4a5f-8068-987dcfeb49bc" acquired by "delete_volume" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[31704704-fb8f-4f34-a145-bc91541d30c4]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:01 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc Sep 17 07:35:01 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:02 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc" returned: 0 in 0.376s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:02 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc Sep 17 07:35:02 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:02 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-4d58a312-93c5-4a5f-8068-987dcfeb49bc" returned: 0 in 0.242s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-quobyte-4d58a312-93c5-4a5f-8068-987dcfeb49bc" released by "delete_volume" :: held 0.658s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:02 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Created reservations ['18dc2243-c714-426e-8848-14240401eec5', '4b641451-0354-49df-aa9f-8b9520c6272c', '417d5005-6b8b-4b80-b9a1-89a2677a3104', '6a8d9583-16bc-4ff3-8e16-b832db08291c'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:02 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:02 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:02 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.249s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:02 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:02 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Deleted volume successfully. Sep 17 07:35:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c7cdcd7a-b646-4f17-80a3-8761a84d5fec tempest-CreateVolumesFromImageTest-1800126068 None] Lock "cinder-4d58a312-93c5-4a5f-8068-987dcfeb49bc-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:35:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:04 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:04 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:05 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.246s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:35:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:35:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:35:07 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:35:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Flow 'volume_create_manager' (fe0c7cb8-6ea2-4a6b-932c-041ec45b1c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6359dfc-9d70-4aef-9837-691c1c8d76bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6359dfc-9d70-4aef-9837-691c1c8d76bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc96bfe0-f10d-44a4-8cb1-5ecb35437e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12149038cb3425f8f389ab2c1521dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:08Z,use_quota=True,user_id='13d8d610bd8c459da5511d24c28c964a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7d07f9-3e94-4e13-819e-ee8ea0708b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7d07f9-3e94-4e13-819e-ee8ea0708b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5d985e-2210-466b-b5a0-6dbaf44a6cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:07 devstack cinder-volume[86029]: DEBUG cinder.image.glance [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Creating Keystone auth plugin from conf {{(pid=86029) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 07:35:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5d985e-2210-466b-b5a0-6dbaf44a6cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc96bfe0-f10d-44a4-8cb1-5ecb35437e18', 'volume_name': 'volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18', 'volume_size': 1, 'image_id': '1ecf5789-db90-44f4-98d0-bd40cfd5c99d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ecf5789-db90-44f4-98d0-bd40cfd5c99d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1426872f2fe8392b3844beb82eea686', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a12149038cb3425f8f389ab2c1521dd6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c139a32b42f9fac6844335d8041feee7b183f1758d43e735bf8ce08f0ab287c21a445baad3191ba06f3978d49a1f8580238f2aba9c11e8e9c1c4688370086013', 'id': '1ecf5789-db90-44f4-98d0-bd40cfd5c99d', 'created_at': datetime.datetime(2026, 9, 17, 5, 35, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 35, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ecf5789-db90-44f4-98d0-bd40cfd5c99d/file', 'properties': {}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5eff9a5-9dce-4063-9d03-cccb2f0540ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5eff9a5-9dce-4063-9d03-cccb2f0540ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7be829-df7b-4ef6-a0db-635f730fb77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:07 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Volume dc96bfe0-f10d-44a4-8cb1-5ecb35437e18: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18', 'volume_size': 1, 'image_id': '1ecf5789-db90-44f4-98d0-bd40cfd5c99d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ecf5789-db90-44f4-98d0-bd40cfd5c99d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1426872f2fe8392b3844beb82eea686', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a12149038cb3425f8f389ab2c1521dd6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c139a32b42f9fac6844335d8041feee7b183f1758d43e735bf8ce08f0ab287c21a445baad3191ba06f3978d49a1f8580238f2aba9c11e8e9c1c4688370086013', 'id': '1ecf5789-db90-44f4-98d0-bd40cfd5c99d', 'created_at': datetime.datetime(2026, 9, 17, 5, 35, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 35, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ecf5789-db90-44f4-98d0-bd40cfd5c99d/file', 'properties': {}}, 'image_service': } Sep 17 07:35:07 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Trying to clone dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 from image 1ecf5789-db90-44f4-98d0-bd40cfd5c99d at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ecf5789-db90-44f4-98d0-bd40cfd5c99d', 'metadata': {}}]). {{(pid=86029) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 07:35:07 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 07:35:07 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Image download 0.00 MB at 0.00 MB/s Sep 17 07:35:08 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f0fdb4-4142-4397-a575-eb1d6a049291]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:08 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD Sep 17 07:35:08 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:08 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD" returned: 0 in 0.325s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:08 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD Sep 17 07:35:08 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:08 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD" returned: 1 in 0.336s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:35:08 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Temporary image 1ecf5789-db90-44f4-98d0-bd40cfd5c99d is fetched for user 13d8d610bd8c459da5511d24c28c964a. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 07:35:08 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7feb664a-3db0-4ca0-a36e-af02276a33d0]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:08 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD Sep 17 07:35:08 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:09 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:09 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD Sep 17 07:35:09 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:09 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD" returned: 1 in 0.322s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc96bfe0-f10d-44a4-8cb1-5ecb35437e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12149038cb3425f8f389ab2c1521dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:08Z,use_quota=True,user_id='13d8d610bd8c459da5511d24c28c964a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Creating volume dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:35:09 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:09 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 1073741824 Sep 17 07:35:09 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:09 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 1073741824" returned: 0 in 0.425s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:09 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 Sep 17 07:35:09 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:10 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18" returned: 0 in 0.243s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:10 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:35:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:10 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Attempting download of 1ecf5789-db90-44f4-98d0-bd40cfd5c99d ((None, [{'url': 'file:///opt/stack/data/glance/images/1ecf5789-db90-44f4-98d0-bd40cfd5c99d', 'metadata': {}}])) to volume dc96bfe0-f10d-44a4-8cb1-5ecb35437e18. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 07:35:10 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e21700a-9aac-4253-b0ce-1ba08c7c73a0]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_xiijq9qa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:10 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_xiijq9qa Sep 17 07:35:10 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:10 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_xiijq9qa" returned: 0 in 0.317s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_xiijq9qa {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:10 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_xiijq9qa Sep 17 07:35:10 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:10 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_xiijq9qa" returned: 1 in 0.328s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_xiijq9qa' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:35:10 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf44617-62f1-4c6d-97cc-c69a93c82060]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:10 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD Sep 17 07:35:10 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:11 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD" returned: 0 in 0.320s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:11 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD Sep 17 07:35:11 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:11 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD" returned: 1 in 0.315s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:35:11 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] 1ecf5789-db90-44f4-98d0-bd40cfd5c99d was raw, converting to qcow2 {{(pid=86029) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 07:35:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:11 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 Sep 17 07:35:11 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:11 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18" returned: 0 in 0.435s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:11 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ecf5789-db90-44f4-98d0-bd40cfd5c99d_j0xh8og8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:35:11 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 07:35:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:11 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 1G Sep 17 07:35:11 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:12 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 1G" returned: 0 in 0.309s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Downloaded image 1ecf5789-db90-44f4-98d0-bd40cfd5c99d ((None, [{'url': 'file:///opt/stack/data/glance/images/1ecf5789-db90-44f4-98d0-bd40cfd5c99d', 'metadata': {}}])) to volume dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 successfully. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Temporary image 1ecf5789-db90-44f4-98d0-bd40cfd5c99d for user 13d8d610bd8c459da5511d24c28c964a is deleted. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Marking volume dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 as bootable. {{(pid=86029) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Copying metadata from image 1ecf5789-db90-44f4-98d0-bd40cfd5c99d to dc96bfe0-f10d-44a4-8cb1-5ecb35437e18. {{(pid=86029) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Creating volume glance metadata for volume dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 backed by image 1ecf5789-db90-44f4-98d0-bd40cfd5c99d with: {'image_id': '1ecf5789-db90-44f4-98d0-bd40cfd5c99d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a1426872f2fe8392b3844beb82eea686', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86029) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7be829-df7b-4ef6-a0db-635f730fb77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18', 'volume_size': 1, 'image_id': '1ecf5789-db90-44f4-98d0-bd40cfd5c99d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ecf5789-db90-44f4-98d0-bd40cfd5c99d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1426872f2fe8392b3844beb82eea686', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a12149038cb3425f8f389ab2c1521dd6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c139a32b42f9fac6844335d8041feee7b183f1758d43e735bf8ce08f0ab287c21a445baad3191ba06f3978d49a1f8580238f2aba9c11e8e9c1c4688370086013', 'id': '1ecf5789-db90-44f4-98d0-bd40cfd5c99d', 'created_at': datetime.datetime(2026, 9, 17, 5, 35, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 35, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ecf5789-db90-44f4-98d0-bd40cfd5c99d/file', 'properties': {}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d38a78c-a8f7-48bb-951c-06da9eca5cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:12 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Volume volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 (dc96bfe0-f10d-44a4-8cb1-5ecb35437e18): created successfully Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d38a78c-a8f7-48bb-951c-06da9eca5cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Flow 'volume_create_manager' (fe0c7cb8-6ea2-4a6b-932c-041ec45b1c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:12 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-56ca95b4-11d3-43b1-9622-01dfb4c5586a tempest-VolumeImageDependencyTests-1043591924 None] Created volume successfully. Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Acquiring lock "cinder-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Lock "cinder-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Acquiring lock "cinder-quobyte-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Lock "cinder-quobyte-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0fe33a-da61-4fbe-866b-c7fba9c5ea7a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:13 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 Sep 17 07:35:13 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:13 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18" returned: 0 in 0.359s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:13 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18 Sep 17 07:35:13 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:13 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18" returned: 0 in 0.252s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Lock "cinder-quobyte-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18" released by "delete_volume" :: held 0.653s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:13 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Created reservations ['2138a004-3281-4691-b36f-831b86ead9ed', '1c62427d-0ea2-4665-9aef-30bd26eabc65', '2c189a7f-ea8e-47f4-b1be-4ed911e4ff6b', '298f5950-2953-43e4-b5bf-6e3fc2dc8578'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:13 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:13 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:13 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:13 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:13 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.253s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:13 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:13 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Deleted volume successfully. Sep 17 07:35:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-080f82ad-76aa-4279-817a-1b37532c1bf4 tempest-VolumeImageDependencyTests-1043591924 None] Lock "cinder-dc96bfe0-f10d-44a4-8cb1-5ecb35437e18-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Flow 'volume_create_manager' (2c7c22cc-a2b7-4215-a044-0687f39fda5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0af48e4-6d8d-40cb-866f-83efe6bb65d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0af48e4-6d8d-40cb-866f-83efe6bb65d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1494093146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fec8e07-d919-4b01-b8cc-8e087f3b37d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc76c3af6af409eae6b8d89599ca0c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:17Z,use_quota=True,user_id='6953a4b36df84fe3a7b6a13df6222e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6cc9de-787c-4423-ae88-0e2f3d7eaaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6cc9de-787c-4423-ae88-0e2f3d7eaaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa08f798-18c8-4664-9820-8d828acbe39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa08f798-18c8-4664-9820-8d828acbe39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fec8e07-d919-4b01-b8cc-8e087f3b37d7', 'volume_name': 'volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d065cf-2154-40dc-b870-7866f177cb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d065cf-2154-40dc-b870-7866f177cb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e075eba-c819-46ce-af36-d3134ba05638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:17 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Volume 7fec8e07-d919-4b01-b8cc-8e087f3b37d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7', 'volume_size': 1} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1494093146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fec8e07-d919-4b01-b8cc-8e087f3b37d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc76c3af6af409eae6b8d89599ca0c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:17Z,use_quota=True,user_id='6953a4b36df84fe3a7b6a13df6222e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Creating volume 7fec8e07-d919-4b01-b8cc-8e087f3b37d7 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:35:17 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:17 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7 1073741824 Sep 17 07:35:17 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:17 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7 1073741824" returned: 0 in 0.410s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:17 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7 Sep 17 07:35:17 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:18 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7" returned: 0 in 0.251s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:35:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e075eba-c819-46ce-af36-d3134ba05638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9e3b0e-e576-49c3-b8cb-066c41022eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:18 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Volume volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7 (7fec8e07-d919-4b01-b8cc-8e087f3b37d7): created successfully Sep 17 07:35:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9e3b0e-e576-49c3-b8cb-066c41022eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Flow 'volume_create_manager' (2c7c22cc-a2b7-4215-a044-0687f39fda5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:18 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-02c73348-bb04-4161-9feb-ec1e4d948b58 tempest-ProjectReaderTests-2066826515 None] Created volume successfully. Sep 17 07:35:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Acquiring lock "cinder-7fec8e07-d919-4b01-b8cc-8e087f3b37d7-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Lock "cinder-7fec8e07-d919-4b01-b8cc-8e087f3b37d7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:18 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=100,cinder:UPDATE=129,cinder:INSERT=38,cinder:DELETE=8 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:35:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Acquiring lock "cinder-quobyte-7fec8e07-d919-4b01-b8cc-8e087f3b37d7" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Lock "cinder-quobyte-7fec8e07-d919-4b01-b8cc-8e087f3b37d7" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:18 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6a2844-4556-475a-b543-21682a9644d0]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:18 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7 Sep 17 07:35:18 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:19 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7" returned: 0 in 0.368s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:19 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7 Sep 17 07:35:19 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:19 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7fec8e07-d919-4b01-b8cc-8e087f3b37d7" returned: 0 in 0.245s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Lock "cinder-quobyte-7fec8e07-d919-4b01-b8cc-8e087f3b37d7" released by "delete_volume" :: held 0.654s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=98,cinder:UPDATE=118,cinder:INSERT=29,cinder:DELETE=12 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Created reservations ['e9da636c-4e4b-4deb-ae43-08bdf231f65b', '105294e8-f60c-4ebc-87fe-277398e653f7', 'e458b192-5493-49ed-baec-e46dfa36e7fe', '79c60b03-e313-4425-acf3-6d39231b1418'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:19 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:19 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:19 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.245s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:19 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Deleted volume successfully. Sep 17 07:35:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b4a1c167-8843-469f-8f73-4ed9cf046761 tempest-ProjectReaderTests-2066826515 None] Lock "cinder-7fec8e07-d919-4b01-b8cc-8e087f3b37d7-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Flow 'volume_create_manager' (f7cf6f07-a313-490f-9ed7-cc646247fbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040c6478-418b-4f52-a5f8-69cfcc9f481c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040c6478-418b-4f52-a5f8-69cfcc9f481c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686554288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba36ab6-428b-4471-916a-7a2dca422d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc76c3af6af409eae6b8d89599ca0c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:20Z,use_quota=True,user_id='6953a4b36df84fe3a7b6a13df6222e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191f990d-9867-4f18-9014-dfe53f94796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191f990d-9867-4f18-9014-dfe53f94796e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c124c4c-ce5c-466d-921c-319dfe789eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c124c4c-ce5c-466d-921c-319dfe789eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ba36ab6-428b-4471-916a-7a2dca422d2e', 'volume_name': 'volume-7ba36ab6-428b-4471-916a-7a2dca422d2e', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5501816-60e8-4d12-9b6c-8e937b6f5027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5501816-60e8-4d12-9b6c-8e937b6f5027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0821b419-d705-4993-aa98-2bf153b24751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:20 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Volume 7ba36ab6-428b-4471-916a-7a2dca422d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ba36ab6-428b-4471-916a-7a2dca422d2e', 'volume_size': 1} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686554288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba36ab6-428b-4471-916a-7a2dca422d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc76c3af6af409eae6b8d89599ca0c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:20Z,use_quota=True,user_id='6953a4b36df84fe3a7b6a13df6222e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Creating volume 7ba36ab6-428b-4471-916a-7a2dca422d2e {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:35:20 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7ba36ab6-428b-4471-916a-7a2dca422d2e 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:20 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7ba36ab6-428b-4471-916a-7a2dca422d2e 1073741824 Sep 17 07:35:20 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:20 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7ba36ab6-428b-4471-916a-7a2dca422d2e 1073741824" returned: 0 in 0.411s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7ba36ab6-428b-4471-916a-7a2dca422d2e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:20 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7ba36ab6-428b-4471-916a-7a2dca422d2e Sep 17 07:35:20 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:20 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7ba36ab6-428b-4471-916a-7a2dca422d2e" returned: 0 in 0.244s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0821b419-d705-4993-aa98-2bf153b24751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ba36ab6-428b-4471-916a-7a2dca422d2e', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5c2d1a-33f5-429b-b635-a1ca5e5dcdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:20 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Volume volume-7ba36ab6-428b-4471-916a-7a2dca422d2e (7ba36ab6-428b-4471-916a-7a2dca422d2e): created successfully Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5c2d1a-33f5-429b-b635-a1ca5e5dcdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Flow 'volume_create_manager' (f7cf6f07-a313-490f-9ed7-cc646247fbda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:20 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-46184a02-8633-4565-b6ae-620c6e5a414c tempest-ProjectReaderTests-2066826515 None] Created volume successfully. Sep 17 07:35:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Acquiring lock "cinder-7ba36ab6-428b-4471-916a-7a2dca422d2e-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Lock "cinder-7ba36ab6-428b-4471-916a-7a2dca422d2e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Acquiring lock "cinder-quobyte-7ba36ab6-428b-4471-916a-7a2dca422d2e" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Lock "cinder-quobyte-7ba36ab6-428b-4471-916a-7a2dca422d2e" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:21 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[105c7afd-c38e-43e5-b5bf-89f38f3d9fca]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7ba36ab6-428b-4471-916a-7a2dca422d2e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:21 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7ba36ab6-428b-4471-916a-7a2dca422d2e Sep 17 07:35:21 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:21 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7ba36ab6-428b-4471-916a-7a2dca422d2e" returned: 0 in 0.356s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7ba36ab6-428b-4471-916a-7a2dca422d2e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:21 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7ba36ab6-428b-4471-916a-7a2dca422d2e Sep 17 07:35:21 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:21 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7ba36ab6-428b-4471-916a-7a2dca422d2e" returned: 0 in 0.252s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Lock "cinder-quobyte-7ba36ab6-428b-4471-916a-7a2dca422d2e" released by "delete_volume" :: held 0.653s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:21 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Created reservations ['269c5b32-48d7-46a0-8938-e329f3cd4516', '5937d271-4c67-4e7d-a062-4bb2b0703467', '3fdf20bd-03df-4d75-af5f-56476f634d64', '121c721c-df95-4855-a91a-787af2373752'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:22 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:22 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:22 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.262s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:22 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Deleted volume successfully. Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-47937b33-ce6c-432e-8fd7-80d41523078d tempest-ProjectReaderTests-2066826515 None] Lock "cinder-7ba36ab6-428b-4471-916a-7a2dca422d2e-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Flow 'volume_create_manager' (c3619410-3c71-41a2-aa43-820c1ce29907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c279c274-02fe-472f-8747-a3151ee9a310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c279c274-02fe-472f-8747-a3151ee9a310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1881542953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9339a75-5cc5-46c8-ad52-5b6d5bb34cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc76c3af6af409eae6b8d89599ca0c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:23Z,use_quota=True,user_id='6953a4b36df84fe3a7b6a13df6222e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffa769b-153e-42f7-902a-fef85f7ae328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffa769b-153e-42f7-902a-fef85f7ae328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3495b514-e296-47ba-bf9e-54ffb27ceddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3495b514-e296-47ba-bf9e-54ffb27ceddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9339a75-5cc5-46c8-ad52-5b6d5bb34cff', 'volume_name': 'volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be834fa0-002b-42b3-8e3d-a455f6db252f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be834fa0-002b-42b3-8e3d-a455f6db252f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46440cac-8dba-486a-ab0e-fbd1b4de5eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:22 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Volume b9339a75-5cc5-46c8-ad52-5b6d5bb34cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff', 'volume_size': 1} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1881542953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9339a75-5cc5-46c8-ad52-5b6d5bb34cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc76c3af6af409eae6b8d89599ca0c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:23Z,use_quota=True,user_id='6953a4b36df84fe3a7b6a13df6222e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Creating volume b9339a75-5cc5-46c8-ad52-5b6d5bb34cff {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:35:22 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:35:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:22 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff 1073741824 Sep 17 07:35:22 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:23 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff 1073741824" returned: 0 in 0.410s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:23 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff Sep 17 07:35:23 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:23 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff" returned: 0 in 0.239s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46440cac-8dba-486a-ab0e-fbd1b4de5eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc90cce5-e5f4-434f-b8ec-a90052d62cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:23 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Volume volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff (b9339a75-5cc5-46c8-ad52-5b6d5bb34cff): created successfully Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc90cce5-e5f4-434f-b8ec-a90052d62cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Flow 'volume_create_manager' (c3619410-3c71-41a2-aa43-820c1ce29907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:23 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cd76133f-a886-44ab-a56a-52335d2532c9 tempest-ProjectReaderTests-2066826515 None] Created volume successfully. Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Acquiring lock "cinder-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Lock "cinder-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Acquiring lock "cinder-quobyte-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Lock "cinder-quobyte-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e5caba-aca9-4527-8aef-2541a577431b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:24 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff Sep 17 07:35:24 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:24 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff" returned: 0 in 0.364s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:24 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff Sep 17 07:35:24 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:24 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff" returned: 0 in 0.247s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Lock "cinder-quobyte-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff" released by "delete_volume" :: held 0.648s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:24 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Created reservations ['dfcf9111-9856-43d2-8c45-8dc95f8c478a', 'a404b53a-0b2e-4728-a81d-bfc17c6916f0', '0bc97233-cc1a-496a-83ca-d1e376756ab0', '8b51920e-f139-4fe9-a9ef-101a1b963b27'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:24 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:24 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:24 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.249s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:24 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:24 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Deleted volume successfully. Sep 17 07:35:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-265afb93-4154-43d6-a303-7f64885200bb tempest-ProjectReaderTests-2066826515 None] Lock "cinder-b9339a75-5cc5-46c8-ad52-5b6d5bb34cff-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Flow 'volume_create_manager' (08b7bc44-08a2-4c38-9029-4069b80a75e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ae4c85-4d3e-4de8-8704-d7941eb0b399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ae4c85-4d3e-4de8-8704-d7941eb0b399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-379042894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9ee8e6-3533-4039-838d-26f287f2075e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc76c3af6af409eae6b8d89599ca0c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:25Z,use_quota=True,user_id='6953a4b36df84fe3a7b6a13df6222e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f00b10-cebb-4dd3-b914-a89a04dd64e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f00b10-cebb-4dd3-b914-a89a04dd64e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4798b950-0291-4022-949f-66cbb3210a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4798b950-0291-4022-949f-66cbb3210a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9ee8e6-3533-4039-838d-26f287f2075e', 'volume_name': 'volume-5f9ee8e6-3533-4039-838d-26f287f2075e', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b19b0fa9-2ce2-4c57-bf8f-14de3d862daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b19b0fa9-2ce2-4c57-bf8f-14de3d862daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01546c1-2f69-47ba-885c-a9bf58f71848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:25 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Volume 5f9ee8e6-3533-4039-838d-26f287f2075e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9ee8e6-3533-4039-838d-26f287f2075e', 'volume_size': 1} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-379042894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9ee8e6-3533-4039-838d-26f287f2075e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc76c3af6af409eae6b8d89599ca0c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:25Z,use_quota=True,user_id='6953a4b36df84fe3a7b6a13df6222e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Creating volume 5f9ee8e6-3533-4039-838d-26f287f2075e {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:35:25 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f9ee8e6-3533-4039-838d-26f287f2075e 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:25 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f9ee8e6-3533-4039-838d-26f287f2075e 1073741824 Sep 17 07:35:25 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:25 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f9ee8e6-3533-4039-838d-26f287f2075e 1073741824" returned: 0 in 0.405s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f9ee8e6-3533-4039-838d-26f287f2075e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:25 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f9ee8e6-3533-4039-838d-26f287f2075e Sep 17 07:35:25 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:26 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f9ee8e6-3533-4039-838d-26f287f2075e" returned: 0 in 0.244s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01546c1-2f69-47ba-885c-a9bf58f71848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9ee8e6-3533-4039-838d-26f287f2075e', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18fdc031-0fd3-45fb-9210-77fc9d146cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:26 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Volume volume-5f9ee8e6-3533-4039-838d-26f287f2075e (5f9ee8e6-3533-4039-838d-26f287f2075e): created successfully Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18fdc031-0fd3-45fb-9210-77fc9d146cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Flow 'volume_create_manager' (08b7bc44-08a2-4c38-9029-4069b80a75e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:26 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4c3bf685-e8f7-4e7b-bac9-6df9bacd8b27 tempest-ProjectReaderTests-2066826515 None] Created volume successfully. Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Acquiring lock "cinder-5f9ee8e6-3533-4039-838d-26f287f2075e-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Lock "cinder-5f9ee8e6-3533-4039-838d-26f287f2075e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Acquiring lock "cinder-quobyte-5f9ee8e6-3533-4039-838d-26f287f2075e" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Lock "cinder-quobyte-5f9ee8e6-3533-4039-838d-26f287f2075e" acquired by "delete_volume" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[412f19fa-0318-4838-a849-fdf10b0619b1]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f9ee8e6-3533-4039-838d-26f287f2075e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:26 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f9ee8e6-3533-4039-838d-26f287f2075e Sep 17 07:35:26 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:26 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f9ee8e6-3533-4039-838d-26f287f2075e" returned: 0 in 0.358s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f9ee8e6-3533-4039-838d-26f287f2075e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:26 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f9ee8e6-3533-4039-838d-26f287f2075e Sep 17 07:35:26 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:27 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f9ee8e6-3533-4039-838d-26f287f2075e" returned: 0 in 0.248s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Lock "cinder-quobyte-5f9ee8e6-3533-4039-838d-26f287f2075e" released by "delete_volume" :: held 0.645s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:27 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Created reservations ['dabf73bf-2074-47fc-aa91-edbfa02951c3', '882c2e19-4f2e-4878-b677-9cfd4145e254', '42e9cbf9-caf9-49bd-aad4-8b0819fd8c4a', 'd12be6b3-7950-41ac-b3fe-959bccee678d'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:27 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:27 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:27 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.252s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:27 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:27 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Deleted volume successfully. Sep 17 07:35:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b75fa69-4b52-4a64-ae3c-91340df952ba tempest-ProjectReaderTests-2066826515 None] Lock "cinder-5f9ee8e6-3533-4039-838d-26f287f2075e-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:37 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:INSERT=9,cinder:UPDATE=40,cinder:SELECT=26,cinder:DELETE=2 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:35:37 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=23,cinder:INSERT=10,cinder:UPDATE=41,cinder:DELETE=5 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:35:39 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:35:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Flow 'volume_create_manager' (a74404f4-aa02-4713-b211-92081a4ff80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef05a5c-1b0e-4d7e-8197-282fc77177e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef05a5c-1b0e-4d7e-8197-282fc77177e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1894788113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93812a1-3b69-44f2-ad8b-db4d7828538b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d36644647342f28f78a459a8c626c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:40Z,use_quota=True,user_id='86d75e62f3b24452922b86b62f402d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918c6bcb-e5b0-4945-a7c8-a71c2ed9bc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:39 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918c6bcb-e5b0-4945-a7c8-a71c2ed9bc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c5cce1-a8e0-42c6-955b-a851a169026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c5cce1-a8e0-42c6-955b-a851a169026e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd93812a1-3b69-44f2-ad8b-db4d7828538b', 'volume_name': 'volume-d93812a1-3b69-44f2-ad8b-db4d7828538b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49373cdf-4a23-4950-8445-ea5194f7a206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49373cdf-4a23-4950-8445-ea5194f7a206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d744333-a2ce-415b-8367-c2b0d6017a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:40 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Volume d93812a1-3b69-44f2-ad8b-db4d7828538b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d93812a1-3b69-44f2-ad8b-db4d7828538b', 'volume_size': 1} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1894788113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93812a1-3b69-44f2-ad8b-db4d7828538b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d36644647342f28f78a459a8c626c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:40Z,use_quota=True,user_id='86d75e62f3b24452922b86b62f402d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Creating volume d93812a1-3b69-44f2-ad8b-db4d7828538b {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:35:40 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:35:40 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b 1073741824 Sep 17 07:35:40 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Flow 'volume_create_manager' (f1c24768-c1a0-4e2c-bc03-671eaa68b18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6118a1a3-bad3-4f04-a4b2-b8d805feb1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6118a1a3-bad3-4f04-a4b2-b8d805feb1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-166895518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19fa63a-f477-47ca-96bd-bdafc777e923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f3bc4af1cc4f2c8010820cc4a3d7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:40Z,use_quota=True,user_id='3b32657f9d994f6da2f43b4e521ffb8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd8e474-fd1f-4d1f-9c2a-e355218435a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd8e474-fd1f-4d1f-9c2a-e355218435a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2879597-bc1c-4ff4-b5d8-098f4a24078e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2879597-bc1c-4ff4-b5d8-098f4a24078e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19fa63a-f477-47ca-96bd-bdafc777e923', 'volume_name': 'volume-d19fa63a-f477-47ca-96bd-bdafc777e923', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138fa638-7fdf-410b-bd64-04d5babee926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138fa638-7fdf-410b-bd64-04d5babee926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cde8a9-b50e-490a-954a-c5933b525095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:40 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Volume d19fa63a-f477-47ca-96bd-bdafc777e923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19fa63a-f477-47ca-96bd-bdafc777e923', 'volume_size': 1} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Flow 'volume_create_manager' (2604dd17-8d38-45e4-8415-1e69543f064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03837ddd-062e-4aeb-bace-9a29481b5d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03837ddd-062e-4aeb-bace-9a29481b5d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2082085575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01953294-c140-40de-8769-19d7887fbf8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f3bc4af1cc4f2c8010820cc4a3d7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:40Z,use_quota=True,user_id='3b32657f9d994f6da2f43b4e521ffb8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6170d0-8dec-40b0-b033-f7e7a952fe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6170d0-8dec-40b0-b033-f7e7a952fe45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3fb13b-4652-472f-b0e2-d1aa855c9289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3fb13b-4652-472f-b0e2-d1aa855c9289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01953294-c140-40de-8769-19d7887fbf8c', 'volume_name': 'volume-01953294-c140-40de-8769-19d7887fbf8c', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c89fe6-fd2a-4469-8a8e-aa7fb86d434a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c89fe6-fd2a-4469-8a8e-aa7fb86d434a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d4612c-62ed-4e3c-a62a-e1649bc1a383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:40 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Volume 01953294-c140-40de-8769-19d7887fbf8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01953294-c140-40de-8769-19d7887fbf8c', 'volume_size': 1} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:40 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b 1073741824" returned: 0 in 0.761s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:40 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b Sep 17 07:35:40 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:40 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Flow 'volume_create_manager' (c5e5bd60-3823-4597-b0a6-6ee7d39f5805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74402b6f-f84c-460f-b695-141175a74cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74402b6f-f84c-460f-b695-141175a74cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-824225302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44e0e7c-b7a0-4450-b1da-eecf8320f68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f3bc4af1cc4f2c8010820cc4a3d7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:41Z,use_quota=True,user_id='3b32657f9d994f6da2f43b4e521ffb8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac66e531-6b30-4705-8e89-07c4f1ff520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac66e531-6b30-4705-8e89-07c4f1ff520b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d539063e-c7f3-413f-b623-9e8f6d34c9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d539063e-c7f3-413f-b623-9e8f6d34c9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44e0e7c-b7a0-4450-b1da-eecf8320f68d', 'volume_name': 'volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ee27a3-2d23-457f-8a06-c2628f31f26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ee27a3-2d23-457f-8a06-c2628f31f26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db26d545-8472-4b9e-9b28-7d0f52300b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:41 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Volume a44e0e7c-b7a0-4450-b1da-eecf8320f68d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d', 'volume_size': 1} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:41 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b" returned: 0 in 0.311s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.765s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-166895518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19fa63a-f477-47ca-96bd-bdafc777e923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f3bc4af1cc4f2c8010820cc4a3d7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:40Z,use_quota=True,user_id='3b32657f9d994f6da2f43b4e521ffb8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Creating volume d19fa63a-f477-47ca-96bd-bdafc777e923 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:35:41 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d19fa63a-f477-47ca-96bd-bdafc777e923 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d744333-a2ce-415b-8367-c2b0d6017a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d93812a1-3b69-44f2-ad8b-db4d7828538b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b3d504-3dfd-4ee0-b441-22d1594076f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:41 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d19fa63a-f477-47ca-96bd-bdafc777e923 1073741824 Sep 17 07:35:41 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:41 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Volume volume-d93812a1-3b69-44f2-ad8b-db4d7828538b (d93812a1-3b69-44f2-ad8b-db4d7828538b): created successfully Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b3d504-3dfd-4ee0-b441-22d1594076f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Flow 'volume_create_manager' (a74404f4-aa02-4713-b211-92081a4ff80c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:41 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-356a4a00-7b42-4a70-aa34-87063bfa905f tempest-VolumeDependencyTests-1983371398 None] Created volume successfully. Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Flow 'volume_create_manager' (e35ce00b-fcc2-4b20-8ed6-9695411adbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a7e590-5a5f-4c67-9ed5-166fcf896f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a7e590-5a5f-4c67-9ed5-166fcf896f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1750556244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94510668-8730-48a0-a469-c043e47c9788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f3bc4af1cc4f2c8010820cc4a3d7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:41Z,use_quota=True,user_id='3b32657f9d994f6da2f43b4e521ffb8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcefc173-6804-4ac5-82be-991079465f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcefc173-6804-4ac5-82be-991079465f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de888285-4dec-4885-a66e-eae52179732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de888285-4dec-4885-a66e-eae52179732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94510668-8730-48a0-a469-c043e47c9788', 'volume_name': 'volume-94510668-8730-48a0-a469-c043e47c9788', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72903a0a-9766-476e-9f06-a05c18af0031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72903a0a-9766-476e-9f06-a05c18af0031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0303bb-7107-4abb-8377-b2262e917396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:41 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Volume 94510668-8730-48a0-a469-c043e47c9788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94510668-8730-48a0-a469-c043e47c9788', 'volume_size': 1} Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:41 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d19fa63a-f477-47ca-96bd-bdafc777e923 1073741824" returned: 0 in 0.760s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d19fa63a-f477-47ca-96bd-bdafc777e923 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:42 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d19fa63a-f477-47ca-96bd-bdafc777e923 Sep 17 07:35:42 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Flow 'volume_create_manager' (8a9c7446-d8c7-459f-aaf9-d4a80d9c6af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f86acf-6863-43e8-9f70-7db26cee36a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f86acf-6863-43e8-9f70-7db26cee36a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1617165949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fdba36-ce70-4196-9758-b5f5a1b098f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f3bc4af1cc4f2c8010820cc4a3d7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:42Z,use_quota=True,user_id='3b32657f9d994f6da2f43b4e521ffb8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65ef75c-9d0f-4ed5-a85c-55d19920ea16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65ef75c-9d0f-4ed5-a85c-55d19920ea16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:42 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa013cc-df44-45fd-b7e9-c64537c44a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa013cc-df44-45fd-b7e9-c64537c44a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08fdba36-ce70-4196-9758-b5f5a1b098f6', 'volume_name': 'volume-08fdba36-ce70-4196-9758-b5f5a1b098f6', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c10cd1-114b-4309-a0cd-98f8877b1668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c10cd1-114b-4309-a0cd-98f8877b1668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d195739f-a04c-46f8-aad1-2a9db503895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:42 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Volume 08fdba36-ce70-4196-9758-b5f5a1b098f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08fdba36-ce70-4196-9758-b5f5a1b098f6', 'volume_size': 1} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d19fa63a-f477-47ca-96bd-bdafc777e923" returned: 0 in 0.379s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.801s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2082085575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01953294-c140-40de-8769-19d7887fbf8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f3bc4af1cc4f2c8010820cc4a3d7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:40Z,use_quota=True,user_id='3b32657f9d994f6da2f43b4e521ffb8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Creating volume 01953294-c140-40de-8769-19d7887fbf8c {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:35:42 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01953294-c140-40de-8769-19d7887fbf8c 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cde8a9-b50e-490a-954a-c5933b525095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19fa63a-f477-47ca-96bd-bdafc777e923', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:42 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01953294-c140-40de-8769-19d7887fbf8c 1073741824 Sep 17 07:35:42 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb4b2dd-04c6-41e5-a3bf-38c2c15608b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:42 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Volume volume-d19fa63a-f477-47ca-96bd-bdafc777e923 (d19fa63a-f477-47ca-96bd-bdafc777e923): created successfully Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb4b2dd-04c6-41e5-a3bf-38c2c15608b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Flow 'volume_create_manager' (f1c24768-c1a0-4e2c-bc03-671eaa68b18c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:42 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-bbaba3e9-e8a3-4d17-a9bb-b45d19642ae2 tempest-CreateVolumesFromImageTest-689874236 None] Created volume successfully. Sep 17 07:35:42 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01953294-c140-40de-8769-19d7887fbf8c 1073741824" returned: 0 in 0.523s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01953294-c140-40de-8769-19d7887fbf8c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:43 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01953294-c140-40de-8769-19d7887fbf8c Sep 17 07:35:43 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Flow 'volume_create_manager' (7e83aa0d-87c4-46e7-94bd-1eb3952c5a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (332b7839-71fa-4d0e-935e-40109170cce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (332b7839-71fa-4d0e-935e-40109170cce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8017ef1d-a9f2-4967-96a0-942fad08789a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc44c3ccd67549d2b4b0cb6e8d7a979a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:43Z,use_quota=True,user_id='53ca8fd489814059abe46c7a02119a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (428cf6d7-ae6c-443a-bd40-932a60c592ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (428cf6d7-ae6c-443a-bd40-932a60c592ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1da8fe-5a82-4c70-8f64-a9d59b26f193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.image.glance [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Creating Keystone auth plugin from conf {{(pid=86029) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 07:35:43 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01953294-c140-40de-8769-19d7887fbf8c" returned: 0 in 0.283s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.152s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-824225302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44e0e7c-b7a0-4450-b1da-eecf8320f68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f3bc4af1cc4f2c8010820cc4a3d7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:41Z,use_quota=True,user_id='3b32657f9d994f6da2f43b4e521ffb8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Creating volume a44e0e7c-b7a0-4450-b1da-eecf8320f68d {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:35:43 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d4612c-62ed-4e3c-a62a-e1649bc1a383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01953294-c140-40de-8769-19d7887fbf8c', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:43 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d 1073741824 Sep 17 07:35:43 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e64f85-7173-42c7-bd0a-bff3d3fb2be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:43 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Volume volume-01953294-c140-40de-8769-19d7887fbf8c (01953294-c140-40de-8769-19d7887fbf8c): created successfully Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e64f85-7173-42c7-bd0a-bff3d3fb2be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Flow 'volume_create_manager' (2604dd17-8d38-45e4-8415-1e69543f064e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:43 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e0c84a8a-dd00-4d1d-871e-ff9b4275e76e tempest-CreateVolumesFromImageTest-689874236 None] Created volume successfully. Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1da8fe-5a82-4c70-8f64-a9d59b26f193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8017ef1d-a9f2-4967-96a0-942fad08789a', 'volume_name': 'volume-8017ef1d-a9f2-4967-96a0-942fad08789a', 'volume_size': 1, 'image_id': 'f5708fff-cd72-420d-b66f-5eddf5faa033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5708fff-cd72-420d-b66f-5eddf5faa033', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53b312d962cc6b0bb3dd0a4807e35fd7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc44c3ccd67549d2b4b0cb6e8d7a979a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ede11a5c011948662fcc2683ef3a2425d70d24d41d948b4b74918ac572273c8aaece9a2dd35ec0c53a20339e04a8df5488494c9d38efddd96462b0c084d24074', 'id': 'f5708fff-cd72-420d-b66f-5eddf5faa033', 'created_at': datetime.datetime(2026, 9, 17, 5, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5708fff-cd72-420d-b66f-5eddf5faa033/file', 'properties': {}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf32db61-81eb-4646-a53f-3a38c3c3baaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf32db61-81eb-4646-a53f-3a38c3c3baaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ff4ea83-dff1-4632-ba0d-b18b6a1a48cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:43 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Volume 8017ef1d-a9f2-4967-96a0-942fad08789a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8017ef1d-a9f2-4967-96a0-942fad08789a', 'volume_size': 1, 'image_id': 'f5708fff-cd72-420d-b66f-5eddf5faa033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5708fff-cd72-420d-b66f-5eddf5faa033', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53b312d962cc6b0bb3dd0a4807e35fd7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc44c3ccd67549d2b4b0cb6e8d7a979a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ede11a5c011948662fcc2683ef3a2425d70d24d41d948b4b74918ac572273c8aaece9a2dd35ec0c53a20339e04a8df5488494c9d38efddd96462b0c084d24074', 'id': 'f5708fff-cd72-420d-b66f-5eddf5faa033', 'created_at': datetime.datetime(2026, 9, 17, 5, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5708fff-cd72-420d-b66f-5eddf5faa033/file', 'properties': {}}, 'image_service': } Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Trying to clone 8017ef1d-a9f2-4967-96a0-942fad08789a from image f5708fff-cd72-420d-b66f-5eddf5faa033 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f5708fff-cd72-420d-b66f-5eddf5faa033', 'metadata': {}}]). {{(pid=86029) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 07:35:43 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Image download 0.00 MB at 0.00 MB/s Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9ae74c-026c-4332-b52a-f09a7d54022c]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:43 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d 1073741824" returned: 0 in 0.502s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:43 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD Sep 17 07:35:43 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:43 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d Sep 17 07:35:43 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:44 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:44 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d" returned: 0 in 0.274s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.481s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1750556244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94510668-8730-48a0-a469-c043e47c9788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f3bc4af1cc4f2c8010820cc4a3d7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:41Z,use_quota=True,user_id='3b32657f9d994f6da2f43b4e521ffb8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Creating volume 94510668-8730-48a0-a469-c043e47c9788 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:35:44 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94510668-8730-48a0-a469-c043e47c9788 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:44 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94510668-8730-48a0-a469-c043e47c9788 1073741824 Sep 17 07:35:44 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db26d545-8472-4b9e-9b28-7d0f52300b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c783c400-f3ae-4c0e-8250-33a9133ad1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:44 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Volume volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d (a44e0e7c-b7a0-4450-b1da-eecf8320f68d): created successfully Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c783c400-f3ae-4c0e-8250-33a9133ad1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Flow 'volume_create_manager' (c5e5bd60-3823-4597-b0a6-6ee7d39f5805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:44 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e1a00a90-fb8f-42e1-9909-f60c23340e2d tempest-CreateVolumesFromImageTest-689874236 None] Created volume successfully. Sep 17 07:35:44 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD Sep 17 07:35:44 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Flow 'volume_create_manager' (fd2c42aa-3484-4824-b569-506dc50fb272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7f1556-29fb-42af-ad8b-8b84dcebdd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7f1556-29fb-42af-ad8b-8b84dcebdd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34509d37-7df1-4f74-bd43-003d10725ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e835cd91d66d49e099a6d3e271ff9640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:44Z,use_quota=True,user_id='eb072e341d484e96984637255916df76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d667c0b5-7f7e-470e-a026-9d1e30af70b1),volume_type_id=d667c0b5-7f7e-470e-a026-9d1e30af70b1)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71ae85d-02e2-41e4-a90d-8f6c43ede67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71ae85d-02e2-41e4-a90d-8f6c43ede67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231b2934-981e-40c5-b2f4-c45cdbdcb732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.image.glance [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Creating Keystone auth plugin from conf {{(pid=86029) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 07:35:44 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD" returned: 1 in 0.460s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Temporary image f5708fff-cd72-420d-b66f-5eddf5faa033 is fetched for user 53ca8fd489814059abe46c7a02119a76. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c6d0e0-cdec-4e84-9396-494852fc06a2]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231b2934-981e-40c5-b2f4-c45cdbdcb732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34509d37-7df1-4f74-bd43-003d10725ddf', 'volume_name': 'volume-34509d37-7df1-4f74-bd43-003d10725ddf', 'volume_size': 1, 'image_id': '709ea363-d483-46d8-9e36-817975caa05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/709ea363-d483-46d8-9e36-817975caa05e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '673786696084e781752c7e58edd6a770', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e835cd91d66d49e099a6d3e271ff9640', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c1363d3c339bf7aae12fc560acf8f7b99ead19d398c26d695a15f366eb286259cd8a8346fbe2bb4077ac02de1dcfe2d9037a24dd2d7710a0d4c4fd0ee417919', 'id': '709ea363-d483-46d8-9e36-817975caa05e', 'created_at': datetime.datetime(2026, 9, 17, 5, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/709ea363-d483-46d8-9e36-817975caa05e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9eb605-ebff-4e3b-a963-4797b05be10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9eb605-ebff-4e3b-a963-4797b05be10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:44 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc097dc-a359-4435-a99c-67784f2ea6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:44 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Volume 34509d37-7df1-4f74-bd43-003d10725ddf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34509d37-7df1-4f74-bd43-003d10725ddf', 'volume_size': 1, 'image_id': '709ea363-d483-46d8-9e36-817975caa05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/709ea363-d483-46d8-9e36-817975caa05e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '673786696084e781752c7e58edd6a770', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e835cd91d66d49e099a6d3e271ff9640', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c1363d3c339bf7aae12fc560acf8f7b99ead19d398c26d695a15f366eb286259cd8a8346fbe2bb4077ac02de1dcfe2d9037a24dd2d7710a0d4c4fd0ee417919', 'id': '709ea363-d483-46d8-9e36-817975caa05e', 'created_at': datetime.datetime(2026, 9, 17, 5, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/709ea363-d483-46d8-9e36-817975caa05e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Trying to clone 34509d37-7df1-4f74-bd43-003d10725ddf from image 709ea363-d483-46d8-9e36-817975caa05e at location (None, [{'url': 'file:///opt/stack/data/glance/images/709ea363-d483-46d8-9e36-817975caa05e', 'metadata': {}}]). {{(pid=86029) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94510668-8730-48a0-a469-c043e47c9788 1073741824" returned: 0 in 0.548s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:44 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD Sep 17 07:35:44 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94510668-8730-48a0-a469-c043e47c9788 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:44 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94510668-8730-48a0-a469-c043e47c9788 Sep 17 07:35:44 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 07:35:44 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Image download 0.00 MB at 0.00 MB/s Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee68a44-bce9-4b32-b27f-afb048a43266]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:44 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD Sep 17 07:35:44 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:44 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:45 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94510668-8730-48a0-a469-c043e47c9788" returned: 0 in 0.264s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.591s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1617165949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fdba36-ce70-4196-9758-b5f5a1b098f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f3bc4af1cc4f2c8010820cc4a3d7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:42Z,use_quota=True,user_id='3b32657f9d994f6da2f43b4e521ffb8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Creating volume 08fdba36-ce70-4196-9758-b5f5a1b098f6 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:35:45 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-08fdba36-ce70-4196-9758-b5f5a1b098f6 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0303bb-7107-4abb-8377-b2262e917396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94510668-8730-48a0-a469-c043e47c9788', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:45 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-08fdba36-ce70-4196-9758-b5f5a1b098f6 1073741824 Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c746ff7e-1266-4149-9b2f-69f1ea2f8fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:45 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:45 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Volume volume-94510668-8730-48a0-a469-c043e47c9788 (94510668-8730-48a0-a469-c043e47c9788): created successfully Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c746ff7e-1266-4149-9b2f-69f1ea2f8fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Flow 'volume_create_manager' (e35ce00b-fcc2-4b20-8ed6-9695411adbd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:45 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD Sep 17 07:35:45 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:45 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-79f07fb0-a568-4ca0-88f9-deae8e1d7313 tempest-CreateVolumesFromImageTest-689874236 None] Created volume successfully. Sep 17 07:35:45 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:45 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD" returned: 1 in 0.435s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:35:45 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD Sep 17 07:35:45 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:45 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-08fdba36-ce70-4196-9758-b5f5a1b098f6 1073741824" returned: 0 in 0.585s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-08fdba36-ce70-4196-9758-b5f5a1b098f6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:45 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-08fdba36-ce70-4196-9758-b5f5a1b098f6 Sep 17 07:35:45 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:45 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD" returned: 1 in 0.411s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Temporary image 709ea363-d483-46d8-9e36-817975caa05e is fetched for user eb072e341d484e96984637255916df76. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e41b2ba-8ce5-42ad-b71c-836bb27b847d]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:45 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD Sep 17 07:35:45 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:45 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-08fdba36-ce70-4196-9758-b5f5a1b098f6" returned: 0 in 0.264s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.439s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d195739f-a04c-46f8-aad1-2a9db503895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08fdba36-ce70-4196-9758-b5f5a1b098f6', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7355ee2-3851-488e-b563-69adae6c9ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:45 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Volume volume-08fdba36-ce70-4196-9758-b5f5a1b098f6 (08fdba36-ce70-4196-9758-b5f5a1b098f6): created successfully Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7355ee2-3851-488e-b563-69adae6c9ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Flow 'volume_create_manager' (8a9c7446-d8c7-459f-aaf9-d4a80d9c6af3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] Creating offline snapshot 9807b4aa-a676-489e-b246-de71637b01d5 of volume d93812a1-3b69-44f2-ad8b-db4d7828538b {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:35:45 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0718262f-a2ee-4b08-8212-73fad0b1678c tempest-CreateVolumesFromImageTest-689874236 None] Created volume successfully. Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1d0049-2204-4382-bacd-b44d0fd2c1fd]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:46 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:46 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b Sep 17 07:35:46 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:46 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD Sep 17 07:35:46 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:46 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b" returned: 0 in 0.382s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:46 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 1G Sep 17 07:35:46 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:46 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "cinder-08fdba36-ce70-4196-9758-b5f5a1b098f6-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-08fdba36-ce70-4196-9758-b5f5a1b098f6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:46 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 1G" returned: 0 in 0.421s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d93812a1-3b69-44f2-ad8b-db4d7828538b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "cinder-quobyte-08fdba36-ce70-4196-9758-b5f5a1b098f6" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:46 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d93812a1-3b69-44f2-ad8b-db4d7828538b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 Sep 17 07:35:46 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-quobyte-08fdba36-ce70-4196-9758-b5f5a1b098f6" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2081000d-e4fa-4ba4-834b-96b0307f5971]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-08fdba36-ce70-4196-9758-b5f5a1b098f6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:46 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-08fdba36-ce70-4196-9758-b5f5a1b098f6 Sep 17 07:35:46 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:47 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d93812a1-3b69-44f2-ad8b-db4d7828538b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5" returned: 0 in 0.303s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:47 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 is being set with open permissions: ugo+rw Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:47 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 Sep 17 07:35:47 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:47 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-08fdba36-ce70-4196-9758-b5f5a1b098f6" returned: 0 in 0.386s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-08fdba36-ce70-4196-9758-b5f5a1b098f6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:47 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-08fdba36-ce70-4196-9758-b5f5a1b098f6 Sep 17 07:35:47 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:47 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5" returned: 0 in 0.269s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:47 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.info Sep 17 07:35:47 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:47 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-08fdba36-ce70-4196-9758-b5f5a1b098f6" returned: 0 in 0.286s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-quobyte-08fdba36-ce70-4196-9758-b5f5a1b098f6" released by "delete_volume" :: held 0.718s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Created reservations ['b4af7413-cf32-4252-a269-592850ac8856', '9d0b9f92-0164-4db8-bc32-8d3abc3b719d', '953cf831-5866-4ed8-804d-613c61530920', 'ef256983-68e7-40de-b5be-fe5b35958a75'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:47 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.info" returned: 0 in 0.302s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:47 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.info is being set with open permissions: ugo+rw Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:47 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.info Sep 17 07:35:47 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:47 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:47 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "cinder-94510668-8730-48a0-a469-c043e47c9788-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-94510668-8730-48a0-a469-c043e47c9788-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:47 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "cinder-quobyte-94510668-8730-48a0-a469-c043e47c9788" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:47 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.info" returned: 0 in 0.286s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.610s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8017ef1d-a9f2-4967-96a0-942fad08789a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc44c3ccd67549d2b4b0cb6e8d7a979a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:43Z,use_quota=True,user_id='53ca8fd489814059abe46c7a02119a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Creating volume 8017ef1d-a9f2-4967-96a0-942fad08789a {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:35:48 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:48 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-quobyte-94510668-8730-48a0-a469-c043e47c9788" acquired by "delete_volume" :: waited 0.073s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:48 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a 1073741824 Sep 17 07:35:48 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.313s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:48 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Deleted volume successfully. Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[473f0dfb-303a-4c59-b7ff-bc6375e79474]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94510668-8730-48a0-a469-c043e47c9788 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:48 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2b163752-aa7e-41c3-8ca2-df0effb4be1f tempest-VolumeDependencyTests-1983371398 None] Create snapshot completed successfully Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b4542689-08e8-42ef-afc3-f3e2ed21ced0 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-08fdba36-ce70-4196-9758-b5f5a1b098f6-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:48 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94510668-8730-48a0-a469-c043e47c9788 Sep 17 07:35:48 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:48 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a 1073741824" returned: 0 in 0.482s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:48 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94510668-8730-48a0-a469-c043e47c9788" returned: 0 in 0.445s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94510668-8730-48a0-a469-c043e47c9788 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:48 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94510668-8730-48a0-a469-c043e47c9788 Sep 17 07:35:48 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:48 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a Sep 17 07:35:48 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:48 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-94510668-8730-48a0-a469-c043e47c9788" returned: 0 in 0.256s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-quobyte-94510668-8730-48a0-a469-c043e47c9788" released by "delete_volume" :: held 0.763s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:48 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a" returned: 0 in 0.289s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.433s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34509d37-7df1-4f74-bd43-003d10725ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e835cd91d66d49e099a6d3e271ff9640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:44Z,use_quota=True,user_id='eb072e341d484e96984637255916df76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d667c0b5-7f7e-470e-a026-9d1e30af70b1),volume_type_id=d667c0b5-7f7e-470e-a026-9d1e30af70b1)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Creating volume 34509d37-7df1-4f74-bd43-003d10725ddf {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:35:48 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:48 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf 1073741824 Sep 17 07:35:48 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Attempting download of f5708fff-cd72-420d-b66f-5eddf5faa033 ((None, [{'url': 'file:///opt/stack/data/glance/images/f5708fff-cd72-420d-b66f-5eddf5faa033', 'metadata': {}}])) to volume 8017ef1d-a9f2-4967-96a0-942fad08789a. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 07:35:48 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Created reservations ['dbdb55b7-5ec5-4f86-8d63-1a48e4333ac9', 'f66ba25d-5b1c-493a-909e-e57cabbca5e1', '1ff4dc62-1a14-40b0-95be-1d13b7adfb02', '8b555065-9c81-48f5-bc56-51878e3407bb'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce616d84-37e5-4276-9d59-5c5b6f22cf04]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5708fff-cd72-420d-b66f-5eddf5faa033_bxhsfy5t {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:49 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:49 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "cinder-a44e0e7c-b7a0-4450-b1da-eecf8320f68d-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:49 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5708fff-cd72-420d-b66f-5eddf5faa033_bxhsfy5t Sep 17 07:35:49 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-a44e0e7c-b7a0-4450-b1da-eecf8320f68d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "cinder-quobyte-a44e0e7c-b7a0-4450-b1da-eecf8320f68d" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Flow 'volume_create_manager' (c15ca756-31df-4904-9bc6-3a2178b44265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fcbea7-5549-410d-8b16-377426102217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fcbea7-5549-410d-8b16-377426102217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-4666054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452ec3d4-510d-4971-a7db-f67d18972492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d36644647342f28f78a459a8c626c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9807b4aa-a676-489e-b246-de71637b01d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:35:49Z,use_quota=True,user_id='86d75e62f3b24452922b86b62f402d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13dbc8fb-fad3-485d-bf38-d85390d15ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13dbc8fb-fad3-485d-bf38-d85390d15ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12949451-dfcd-4c5c-acc2-887101f759e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12949451-dfcd-4c5c-acc2-887101f759e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '452ec3d4-510d-4971-a7db-f67d18972492', 'volume_name': 'volume-452ec3d4-510d-4971-a7db-f67d18972492', 'volume_size': 1, 'snapshot_id': '9807b4aa-a676-489e-b246-de71637b01d5'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7245c9-6b98-49c2-ae2f-a4a71cbfdf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7245c9-6b98-49c2-ae2f-a4a71cbfdf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccb948e-3bf3-4e2b-bbe5-059dfa3552ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:49 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Volume 452ec3d4-510d-4971-a7db-f67d18972492: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-452ec3d4-510d-4971-a7db-f67d18972492', 'volume_size': 1, 'snapshot_id': '9807b4aa-a676-489e-b246-de71637b01d5'} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-quobyte-a44e0e7c-b7a0-4450-b1da-eecf8320f68d" acquired by "delete_volume" :: waited 0.109s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[30514b9b-d41c-4307-9cda-762a4e00ecc9]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:49 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.352s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:49 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Deleted volume successfully. Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2676b4d9-649e-4c3c-adc4-c9309d6b68d1 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-94510668-8730-48a0-a469-c043e47c9788-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:49 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf 1073741824" returned: 0 in 0.659s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:49 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5708fff-cd72-420d-b66f-5eddf5faa033_bxhsfy5t" returned: 0 in 0.544s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5708fff-cd72-420d-b66f-5eddf5faa033_bxhsfy5t {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:49 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d Sep 17 07:35:49 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:49 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf Sep 17 07:35:49 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:49 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5708fff-cd72-420d-b66f-5eddf5faa033_bxhsfy5t Sep 17 07:35:49 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:49 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d" returned: 0 in 0.396s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:49 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf" returned: 0 in 0.262s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.441s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "cinder-quobyte-9807b4aa-a676-489e-b246-de71637b01d5-452ec3d4-510d-4971-a7db-f67d18972492" by "_create_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:49 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d Sep 17 07:35:49 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-quobyte-9807b4aa-a676-489e-b246-de71637b01d5-452ec3d4-510d-4971-a7db-f67d18972492" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Creating volume 452ec3d4-510d-4971-a7db-f67d18972492 from snapshot 9807b4aa-a676-489e-b246-de71637b01d5 {{(pid=86029) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:49 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "cinder-quobyte-452ec3d4-510d-4971-a7db-f67d18972492" by "_copy_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5708fff-cd72-420d-b66f-5eddf5faa033_bxhsfy5t" returned: 1 in 0.356s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5708fff-cd72-420d-b66f-5eddf5faa033_bxhsfy5t' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Attempting download of 709ea363-d483-46d8-9e36-817975caa05e ((None, [{'url': 'file:///opt/stack/data/glance/images/709ea363-d483-46d8-9e36-817975caa05e', 'metadata': {}}])) to volume 34509d37-7df1-4f74-bd43-003d10725ddf. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e1e141-f885-43e3-aff3-4008d9bec81f]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-quobyte-452ec3d4-510d-4971-a7db-f67d18972492" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] snapshot: 9807b4aa-a676-489e-b246-de71637b01d5, volume: 452ec3d4-510d-4971-a7db-f67d18972492, {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:49 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbef5948-e030-4811-94ce-533b48963d76]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_709ea363-d483-46d8-9e36-817975caa05e_10bkzk6s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[79838e51-e6bb-408b-9047-e7233ff2ba25]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:50 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD Sep 17 07:35:50 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:50 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_709ea363-d483-46d8-9e36-817975caa05e_10bkzk6s Sep 17 07:35:50 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:50 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:50 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a44e0e7c-b7a0-4450-b1da-eecf8320f68d" returned: 0 in 0.310s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:50 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-quobyte-a44e0e7c-b7a0-4450-b1da-eecf8320f68d" released by "delete_volume" :: held 0.770s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Created reservations ['399c0401-28f9-4410-a315-e6f67b3c303e', '45150488-dc26-4b68-a8ee-c75910239946', '5826a79f-0a73-4965-84f7-b34f5b621edf', '52cec943-80d7-4bfc-aa05-f60848f75e2d'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:50 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:50 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:50 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:50 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_709ea363-d483-46d8-9e36-817975caa05e_10bkzk6s" returned: 0 in 0.391s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_709ea363-d483-46d8-9e36-817975caa05e_10bkzk6s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "cinder-01953294-c140-40de-8769-19d7887fbf8c-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-01953294-c140-40de-8769-19d7887fbf8c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "cinder-quobyte-01953294-c140-40de-8769-19d7887fbf8c" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:50 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-quobyte-01953294-c140-40de-8769-19d7887fbf8c" acquired by "delete_volume" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:50 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5" returned: 0 in 0.528s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d93812a1-3b69-44f2-ad8b-db4d7828538b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:35:50 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[db06bc28-e82e-4785-bbd2-ef74b9533f8b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aece618-e412-4523-bedb-fb41bb083909]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:50 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_709ea363-d483-46d8-9e36-817975caa05e_10bkzk6s Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01953294-c140-40de-8769-19d7887fbf8c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:50 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:50 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b Sep 17 07:35:50 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:50 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.454s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:50 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Deleted volume successfully. Sep 17 07:35:50 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01953294-c140-40de-8769-19d7887fbf8c Sep 17 07:35:50 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4481c91d-6420-4058-8c7e-f4557def03b8 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-a44e0e7c-b7a0-4450-b1da-eecf8320f68d-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:50 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD" returned: 1 in 0.550s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] f5708fff-cd72-420d-b66f-5eddf5faa033 was raw, converting to qcow2 {{(pid=86029) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 07:35:50 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_709ea363-d483-46d8-9e36-817975caa05e_10bkzk6s" returned: 1 in 0.506s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_709ea363-d483-46d8-9e36-817975caa05e_10bkzk6s' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31e1482-70c3-433e-9e44-2c920ac9518f]: (4, 'raw') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:50 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a Sep 17 07:35:50 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:51 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b" returned: 0 in 0.462s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] will copy from snapshot at /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Creating direct copy from snapshot {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 07:35:51 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD Sep 17 07:35:51 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG cinder.utils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Path /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492 not found in is_blk_device check {{(pid=86029) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:51 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01953294-c140-40de-8769-19d7887fbf8c" returned: 0 in 0.476s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01953294-c140-40de-8769-19d7887fbf8c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:51 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492 Sep 17 07:35:51 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:51 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01953294-c140-40de-8769-19d7887fbf8c Sep 17 07:35:51 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:51 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:51 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a" returned: 0 in 0.514s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f5708fff-cd72-420d-b66f-5eddf5faa033_v2xafa3gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:35:51 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 07:35:51 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:51 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD Sep 17 07:35:51 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-01953294-c140-40de-8769-19d7887fbf8c" returned: 0 in 0.359s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:51 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a 1G Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-quobyte-01953294-c140-40de-8769-19d7887fbf8c" released by "delete_volume" :: held 0.925s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:51 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Created reservations ['b93785e2-afcd-4fbc-9c78-e6868f17d9e1', '6980d851-68c0-455a-820d-2801b187f7d6', '275f5c06-b0f8-4d52-9f34-21ecd84fc1ec', 'a610724c-cfa7-45e3-a068-df0d12ea7d5e'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:51 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD" returned: 1 in 0.391s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] 709ea363-d483-46d8-9e36-817975caa05e was raw, converting to qcow2 {{(pid=86029) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:51 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:51 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:51 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:51 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "cinder-d19fa63a-f477-47ca-96bd-bdafc777e923-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-d19fa63a-f477-47ca-96bd-bdafc777e923-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "cinder-quobyte-d19fa63a-f477-47ca-96bd-bdafc777e923" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-quobyte-d19fa63a-f477-47ca-96bd-bdafc777e923" acquired by "delete_volume" :: waited 0.038s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[731edcf4-6874-4d3d-bc74-d56cc8df9268]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d19fa63a-f477-47ca-96bd-bdafc777e923 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:52 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a 1G" returned: 0 in 0.896s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Downloaded image f5708fff-cd72-420d-b66f-5eddf5faa033 ((None, [{'url': 'file:///opt/stack/data/glance/images/f5708fff-cd72-420d-b66f-5eddf5faa033', 'metadata': {}}])) to volume 8017ef1d-a9f2-4967-96a0-942fad08789a successfully. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Temporary image f5708fff-cd72-420d-b66f-5eddf5faa033 for user 53ca8fd489814059abe46c7a02119a76 is deleted. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Marking volume 8017ef1d-a9f2-4967-96a0-942fad08789a as bootable. {{(pid=86029) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 07:35:52 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.561s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:52 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Deleted volume successfully. Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Copying metadata from image f5708fff-cd72-420d-b66f-5eddf5faa033 to 8017ef1d-a9f2-4967-96a0-942fad08789a. {{(pid=86029) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Creating volume glance metadata for volume 8017ef1d-a9f2-4967-96a0-942fad08789a backed by image f5708fff-cd72-420d-b66f-5eddf5faa033 with: {'image_id': 'f5708fff-cd72-420d-b66f-5eddf5faa033', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '53b312d962cc6b0bb3dd0a4807e35fd7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86029) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-482f630c-4fe0-4851-acd0-22b64fe9b99b tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-01953294-c140-40de-8769-19d7887fbf8c-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ff4ea83-dff1-4632-ba0d-b18b6a1a48cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8017ef1d-a9f2-4967-96a0-942fad08789a', 'volume_size': 1, 'image_id': 'f5708fff-cd72-420d-b66f-5eddf5faa033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5708fff-cd72-420d-b66f-5eddf5faa033', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53b312d962cc6b0bb3dd0a4807e35fd7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc44c3ccd67549d2b4b0cb6e8d7a979a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ede11a5c011948662fcc2683ef3a2425d70d24d41d948b4b74918ac572273c8aaece9a2dd35ec0c53a20339e04a8df5488494c9d38efddd96462b0c084d24074', 'id': 'f5708fff-cd72-420d-b66f-5eddf5faa033', 'created_at': datetime.datetime(2026, 9, 17, 5, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5708fff-cd72-420d-b66f-5eddf5faa033/file', 'properties': {}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a4c49c-6784-4fb0-85d5-7750de96a629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:52 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d19fa63a-f477-47ca-96bd-bdafc777e923 Sep 17 07:35:52 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:52 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Volume volume-8017ef1d-a9f2-4967-96a0-942fad08789a (8017ef1d-a9f2-4967-96a0-942fad08789a): created successfully Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a4c49c-6784-4fb0-85d5-7750de96a629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Flow 'volume_create_manager' (7e83aa0d-87c4-46e7-94bd-1eb3952c5a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:52 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b49c2548-9b3a-43dc-b5e8-67296e4dc584 tempest-VolumeImageDependencyTests-1677654966 None] Created volume successfully. Sep 17 07:35:52 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf" returned: 0 in 1.139s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_709ea363-d483-46d8-9e36-817975caa05e_ox98_yomdevstack@QuobyteHD, size 0.00 MB, duration 1.14 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:35:52 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 07:35:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:52 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf 1G Sep 17 07:35:52 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Acquiring lock "cinder-8017ef1d-a9f2-4967-96a0-942fad08789a-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Lock "cinder-8017ef1d-a9f2-4967-96a0-942fad08789a-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:53 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d19fa63a-f477-47ca-96bd-bdafc777e923" returned: 0 in 0.882s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d19fa63a-f477-47ca-96bd-bdafc777e923 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Acquiring lock "cinder-quobyte-8017ef1d-a9f2-4967-96a0-942fad08789a" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:53 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d19fa63a-f477-47ca-96bd-bdafc777e923 Sep 17 07:35:53 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Lock "cinder-quobyte-8017ef1d-a9f2-4967-96a0-942fad08789a" acquired by "delete_volume" :: waited 0.040s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed8535d-2d64-4dbd-9f7d-6e8fffcd306a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:53 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a Sep 17 07:35:53 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:53 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf 1G" returned: 0 in 0.889s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Downloaded image 709ea363-d483-46d8-9e36-817975caa05e ((None, [{'url': 'file:///opt/stack/data/glance/images/709ea363-d483-46d8-9e36-817975caa05e', 'metadata': {}}])) to volume 34509d37-7df1-4f74-bd43-003d10725ddf successfully. {{(pid=86029) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Temporary image 709ea363-d483-46d8-9e36-817975caa05e for user eb072e341d484e96984637255916df76 is deleted. {{(pid=86029) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG cinder.volume.volume_utils [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Marking volume 34509d37-7df1-4f74-bd43-003d10725ddf as bootable. {{(pid=86029) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Copying metadata from image 709ea363-d483-46d8-9e36-817975caa05e to 34509d37-7df1-4f74-bd43-003d10725ddf. {{(pid=86029) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Creating volume glance metadata for volume 34509d37-7df1-4f74-bd43-003d10725ddf backed by image 709ea363-d483-46d8-9e36-817975caa05e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '709ea363-d483-46d8-9e36-817975caa05e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '673786696084e781752c7e58edd6a770', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86029) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 07:35:53 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d19fa63a-f477-47ca-96bd-bdafc777e923" returned: 0 in 0.678s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-quobyte-d19fa63a-f477-47ca-96bd-bdafc777e923" released by "delete_volume" :: held 1.693s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc097dc-a359-4435-a99c-67784f2ea6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34509d37-7df1-4f74-bd43-003d10725ddf', 'volume_size': 1, 'image_id': '709ea363-d483-46d8-9e36-817975caa05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/709ea363-d483-46d8-9e36-817975caa05e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '673786696084e781752c7e58edd6a770', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e835cd91d66d49e099a6d3e271ff9640', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c1363d3c339bf7aae12fc560acf8f7b99ead19d398c26d695a15f366eb286259cd8a8346fbe2bb4077ac02de1dcfe2d9037a24dd2d7710a0d4c4fd0ee417919', 'id': '709ea363-d483-46d8-9e36-817975caa05e', 'created_at': datetime.datetime(2026, 9, 17, 5, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 5, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/709ea363-d483-46d8-9e36-817975caa05e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e318cb3-882a-470e-bda1-37bda8ba583d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:35:53 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Volume volume-34509d37-7df1-4f74-bd43-003d10725ddf (34509d37-7df1-4f74-bd43-003d10725ddf): created successfully Sep 17 07:35:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e318cb3-882a-470e-bda1-37bda8ba583d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Flow 'volume_create_manager' (fd2c42aa-3484-4824-b569-506dc50fb272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Created reservations ['12ff4802-c0d7-4832-a027-bf8d79697054', 'a0632a5f-86a0-456f-b5a5-79e960688574', 'f6527a10-f5f5-41f2-9293-d6605585a8f1', '6adab5c9-b4fa-4bc8-9959-4827b1c80d08'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:54 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3e51d9c3-ca8a-4ec4-a364-1bad7ad7fa61 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Created volume successfully. Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:54 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a" returned: 0 in 0.949s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:54 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:54 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:54 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a Sep 17 07:35:54 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Acquiring lock "cinder-34509d37-7df1-4f74-bd43-003d10725ddf-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Lock "cinder-34509d37-7df1-4f74-bd43-003d10725ddf-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Acquiring lock "cinder-quobyte-34509d37-7df1-4f74-bd43-003d10725ddf" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Lock "cinder-quobyte-34509d37-7df1-4f74-bd43-003d10725ddf" acquired by "delete_volume" :: waited 0.050s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc80b312-350a-4ef4-9752-39c35ca24f07]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:54 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.691s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:54 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Deleted volume successfully. Sep 17 07:35:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-aa79ab92-58ad-4ffb-8588-2ef0b4c981e9 tempest-CreateVolumesFromImageTest-689874236 None] Lock "cinder-d19fa63a-f477-47ca-96bd-bdafc777e923-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:55 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-8017ef1d-a9f2-4967-96a0-942fad08789a" returned: 0 in 0.756s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Lock "cinder-quobyte-8017ef1d-a9f2-4967-96a0-942fad08789a" released by "delete_volume" :: held 1.830s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:55 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf Sep 17 07:35:55 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:55 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Created reservations ['95530954-06c5-4dbc-9a1e-24409ad8fabf', '9862f18a-2748-49f7-bf91-7c6e53eb3fb9', '14e49200-a506-4e67-a07f-21325ca05b18', '59717873-e00b-433f-957b-eebdf6bbd228'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:55 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:55 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:55 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:55 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.604s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf" returned: 0 in 1.168s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:55 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:55 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Deleted volume successfully. Sep 17 07:35:55 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf Sep 17 07:35:55 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-75f0c0ab-db04-428f-acbb-a26b6bb89fa1 tempest-VolumeImageDependencyTests-1677654966 None] Lock "cinder-8017ef1d-a9f2-4967-96a0-942fad08789a-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:56 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-34509d37-7df1-4f74-bd43-003d10725ddf" returned: 0 in 0.438s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Lock "cinder-quobyte-34509d37-7df1-4f74-bd43-003d10725ddf" released by "delete_volume" :: held 1.749s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:35:56 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Created reservations ['9d25bc3e-8fc3-4790-ad98-b919e9a87987', 'c72abe57-3cda-490d-b731-0cf85f81e9ae', '747a07e4-b51a-41d6-854f-eb66ebc76efb', 'd98ea803-7c25-4000-a811-ae981c4ccc7f'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:35:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:35:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:35:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:35:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:35:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:35:56 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:35:56 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:35:57 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Sep 17 07:35:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.761s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:35:57 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:35:57 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Deleted volume successfully. Sep 17 07:35:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f95e6c6-20d4-40b2-9611-0ddab194a607 tempest-VolumeAndVolumeTypeFromImageTest-1705451028 None] Lock "cinder-34509d37-7df1-4f74-bd43-003d10725ddf-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:00 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492" returned: 0 in 9.542s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:00 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b, size 1024.00 MB, duration 9.54 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:36:00 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Converted 1024.00 MB image at 107.31 MB/s Sep 17 07:36:00 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492 is being set with open permissions: ugo+rw Sep 17 07:36:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:00 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492 Sep 17 07:36:00 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:00 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492" returned: 0 in 0.298s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-quobyte-452ec3d4-510d-4971-a7db-f67d18972492" released by "_copy_volume_from_snapshot" :: held 10.958s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-quobyte-9807b4aa-a676-489e-b246-de71637b01d5-452ec3d4-510d-4971-a7db-f67d18972492" released by "_create_volume_from_snapshot" :: held 11.064s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.095s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccb948e-3bf3-4e2b-bbe5-059dfa3552ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-452ec3d4-510d-4971-a7db-f67d18972492', 'volume_size': 1, 'snapshot_id': '9807b4aa-a676-489e-b246-de71637b01d5'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d96a93-c48e-47cb-84ad-c2ef2f850013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:01 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Volume volume-452ec3d4-510d-4971-a7db-f67d18972492 (452ec3d4-510d-4971-a7db-f67d18972492): created successfully Sep 17 07:36:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d96a93-c48e-47cb-84ad-c2ef2f850013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Flow 'volume_create_manager' (c15ca756-31df-4904-9bc6-3a2178b44265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-128d4e72-3362-478d-9e50-92ad9de03278 tempest-VolumeDependencyTests-1983371398 None] Created volume successfully. Sep 17 07:36:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "cinder-9807b4aa-a676-489e-b246-de71637b01d5-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-9807b4aa-a676-489e-b246-de71637b01d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "cinder-quobyte-d93812a1-3b69-44f2-ad8b-db4d7828538b" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-quobyte-d93812a1-3b69-44f2-ad8b-db4d7828538b" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "cinder-quobyte-9807b4aa-a676-489e-b246-de71637b01d5" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-quobyte-9807b4aa-a676-489e-b246-de71637b01d5" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Deleting offline snapshot 9807b4aa-a676-489e-b246-de71637b01d5 of volume d93812a1-3b69-44f2-ad8b-db4d7828538b {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:36:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] snapshot_file for this snap is: volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:36:01 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0720f8c6-b94d-414e-b761-fe3b316b905c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:01 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 Sep 17 07:36:01 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Flow 'volume_create_manager' (a0f3eebf-a1d9-4a15-a0d6-f2baa5bf4915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380a537d-b2bc-417a-b5f5-cb2482864e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380a537d-b2bc-417a-b5f5-cb2482864e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-539453158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89bf9528-27c1-403a-8c32-3f5375eda767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113b0cc71ad4a1cb447a3a793943e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:02Z,use_quota=True,user_id='b929770f4ed04a0a8a0abbccddc93ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44c2c1d-694a-4b18-bcaa-443b984ef55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44c2c1d-694a-4b18-bcaa-443b984ef55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58dee328-7f4d-488a-baca-21c5f119b507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58dee328-7f4d-488a-baca-21c5f119b507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89bf9528-27c1-403a-8c32-3f5375eda767', 'volume_name': 'volume-89bf9528-27c1-403a-8c32-3f5375eda767', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d7fc0a-f481-4b56-acd2-a4afc989cfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d7fc0a-f481-4b56-acd2-a4afc989cfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a658a9-2e9a-41dd-9a97-6c847743a34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:02 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume 89bf9528-27c1-403a-8c32-3f5375eda767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89bf9528-27c1-403a-8c32-3f5375eda767', 'volume_size': 1} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-539453158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89bf9528-27c1-403a-8c32-3f5375eda767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113b0cc71ad4a1cb447a3a793943e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:02Z,use_quota=True,user_id='b929770f4ed04a0a8a0abbccddc93ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Creating volume 89bf9528-27c1-403a-8c32-3f5375eda767 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:02 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-89bf9528-27c1-403a-8c32-3f5375eda767 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:02 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-89bf9528-27c1-403a-8c32-3f5375eda767 1073741824 Sep 17 07:36:02 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:02 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5" returned: 0 in 0.522s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d93812a1-3b69-44f2-ad8b-db4d7828538b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa758923-f17f-4fad-918e-c30efe889e69]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:02 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b Sep 17 07:36:02 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:02 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-89bf9528-27c1-403a-8c32-3f5375eda767 1073741824" returned: 0 in 0.582s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-89bf9528-27c1-403a-8c32-3f5375eda767 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:02 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-89bf9528-27c1-403a-8c32-3f5375eda767 Sep 17 07:36:02 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:03 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b" returned: 0 in 0.648s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:03 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 Sep 17 07:36:03 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:03 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-89bf9528-27c1-403a-8c32-3f5375eda767" returned: 0 in 0.296s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a658a9-2e9a-41dd-9a97-6c847743a34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89bf9528-27c1-403a-8c32-3f5375eda767', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0c5907-1ddd-4f16-ab02-dac954d6e3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:03 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume volume-89bf9528-27c1-403a-8c32-3f5375eda767 (89bf9528-27c1-403a-8c32-3f5375eda767): created successfully Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0c5907-1ddd-4f16-ab02-dac954d6e3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Flow 'volume_create_manager' (a0f3eebf-a1d9-4a15-a0d6-f2baa5bf4915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:03 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-30f09794-3470-4e15-aed8-3be2b65466d0 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Created volume successfully. Sep 17 07:36:03 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5" returned: 0 in 0.387s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:03 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5 Sep 17 07:36:03 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:03 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b.9807b4aa-a676-489e-b246-de71637b01d5" returned: 0 in 0.295s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-quobyte-9807b4aa-a676-489e-b246-de71637b01d5" released by "_delete_snapshot" :: held 2.015s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-quobyte-d93812a1-3b69-44f2-ad8b-db4d7828538b" released by "delete_snapshot" :: held 2.059s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Flow 'volume_create_manager' (ab5cd57d-709c-440c-b566-7dd54b8253dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74662471-2d99-457f-a7e1-00f757de673a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74662471-2d99-457f-a7e1-00f757de673a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-386671535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f8a78c-8547-41e8-a8d4-528b135f13f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe5224828af419d9d43f2eaa0fa021e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:04Z,use_quota=True,user_id='06328113b44e4c4084658b9ffaba06c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6170e0b1-b441-42e3-ad50-e9fdf16d98fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6170e0b1-b441-42e3-ad50-e9fdf16d98fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7c0e4c-9d76-4d16-bac1-349041f76014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7c0e4c-9d76-4d16-bac1-349041f76014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f8a78c-8547-41e8-a8d4-528b135f13f3', 'volume_name': 'volume-23f8a78c-8547-41e8-a8d4-528b135f13f3', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438c334e-479e-4bce-a0c0-19b66a7b83cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438c334e-479e-4bce-a0c0-19b66a7b83cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a430a1-a183-4046-a6df-6f415e986056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:03 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Volume 23f8a78c-8547-41e8-a8d4-528b135f13f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f8a78c-8547-41e8-a8d4-528b135f13f3', 'volume_size': 1} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-386671535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f8a78c-8547-41e8-a8d4-528b135f13f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe5224828af419d9d43f2eaa0fa021e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:04Z,use_quota=True,user_id='06328113b44e4c4084658b9ffaba06c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Creating volume 23f8a78c-8547-41e8-a8d4-528b135f13f3 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:03 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:03 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 1073741824 Sep 17 07:36:03 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:03 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Created reservations ['7aadd525-5024-41f4-a92e-cd9c46645a14', '30e23101-b6de-4320-9185-0e1d532b7b44', '3dbe8080-856a-4684-bc13-c2a37cab79bc', 'b373ccd2-20dc-4156-a531-fdb6d5104454'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:04 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Delete snapshot completed successfully. Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b838a575-6d40-43e0-b524-d048e9b76cc6 tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-9807b4aa-a676-489e-b246-de71637b01d5-delete_snapshot" released by "delete_snapshot" :: held 2.354s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:04 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 1073741824" returned: 0 in 0.503s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:04 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 Sep 17 07:36:04 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Flow 'volume_create_manager' (90a574be-2c9c-4f39-bb1a-b9963daff232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e14511-1ab4-47eb-abfc-c8f0917899dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e14511-1ab4-47eb-abfc-c8f0917899dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1503543524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079da111-bcaa-4e63-b301-9e756f14c164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5553294d6aa04276809e4bd71db7504d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:04Z,use_quota=True,user_id='e6dfd475ccfc4de4ac9a70875f9e7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71621ce-ed18-448d-8d53-c76bdfd40e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71621ce-ed18-448d-8d53-c76bdfd40e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0269a7e-6043-4a52-bbbb-fd454f3c8c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0269a7e-6043-4a52-bbbb-fd454f3c8c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '079da111-bcaa-4e63-b301-9e756f14c164', 'volume_name': 'volume-079da111-bcaa-4e63-b301-9e756f14c164', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7123f2f0-6ff3-432e-8f98-abfd77b1b4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7123f2f0-6ff3-432e-8f98-abfd77b1b4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553950c4-ba73-493a-8e14-7fb947fc3c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:04 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume 079da111-bcaa-4e63-b301-9e756f14c164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-079da111-bcaa-4e63-b301-9e756f14c164', 'volume_size': 1} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Flow 'volume_create_manager' (1a4bb5ef-bb48-4c04-9557-5c766c526b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e39c7ef-5f27-4b7e-be8c-70a7d80173a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:04 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e39c7ef-5f27-4b7e-be8c-70a7d80173a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1579506718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee012c9d-0945-49b4-83d9-41a660fd8bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113b0cc71ad4a1cb447a3a793943e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:05Z,use_quota=True,user_id='b929770f4ed04a0a8a0abbccddc93ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a168b6d-f88f-4e2f-9900-a211b0fd9d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a168b6d-f88f-4e2f-9900-a211b0fd9d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:04 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:04 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faacdf26-32a1-48ed-b515-4e631459e41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faacdf26-32a1-48ed-b515-4e631459e41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee012c9d-0945-49b4-83d9-41a660fd8bcd', 'volume_name': 'volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f09ccde-ce94-43e3-923a-ae239c2133c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f09ccde-ce94-43e3-923a-ae239c2133c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d06c42c-13c8-4ab7-ab59-d3574ba0f523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:04 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume ee012c9d-0945-49b4-83d9-41a660fd8bcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd', 'volume_size': 1} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "cinder-d93812a1-3b69-44f2-ad8b-db4d7828538b-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3" returned: 0 in 0.469s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.307s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1503543524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079da111-bcaa-4e63-b301-9e756f14c164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5553294d6aa04276809e4bd71db7504d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:04Z,use_quota=True,user_id='e6dfd475ccfc4de4ac9a70875f9e7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Creating volume 079da111-bcaa-4e63-b301-9e756f14c164 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:04 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-d93812a1-3b69-44f2-ad8b-db4d7828538b-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:05 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164 1073741824 Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a430a1-a183-4046-a6df-6f415e986056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f8a78c-8547-41e8-a8d4-528b135f13f3', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:05 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3eb1b28-5e42-4c4b-91e2-65aaae8e2a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:05 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Volume volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 (23f8a78c-8547-41e8-a8d4-528b135f13f3): created successfully Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3eb1b28-5e42-4c4b-91e2-65aaae8e2a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Flow 'volume_create_manager' (ab5cd57d-709c-440c-b566-7dd54b8253dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "cinder-quobyte-d93812a1-3b69-44f2-ad8b-db4d7828538b" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:05 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-64051bed-8527-47cf-9e74-ce5b74e0c692 tempest-ProjectReaderTests-457785573 None] Created volume successfully. Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-quobyte-d93812a1-3b69-44f2-ad8b-db4d7828538b" acquired by "delete_volume" :: waited 0.035s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:05 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.380s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d17e604-ab11-4c2c-b046-4b98a9a7edd4]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Flow 'volume_create_manager' (7896c885-ac14-43e8-b642-3ed3d71f36f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df78367d-527b-433d-89c5-f1970f16956f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df78367d-527b-433d-89c5-f1970f16956f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-956824880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887f2998-e6e3-4331-8b6a-9cdb74a6931e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113b0cc71ad4a1cb447a3a793943e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:05Z,use_quota=True,user_id='b929770f4ed04a0a8a0abbccddc93ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce2e29a-47b8-488d-b619-38069ef34010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce2e29a-47b8-488d-b619-38069ef34010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78447de6-ddbe-4f0f-9c28-c96a41081b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78447de6-ddbe-4f0f-9c28-c96a41081b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '887f2998-e6e3-4331-8b6a-9cdb74a6931e', 'volume_name': 'volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eaa8c0b-519a-44ab-bf03-f1279d06280c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eaa8c0b-519a-44ab-bf03-f1279d06280c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d09c76-3fe8-4a18-89e0-255efee96780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:05 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume 887f2998-e6e3-4331-8b6a-9cdb74a6931e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e', 'volume_size': 1} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:05 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b Sep 17 07:36:05 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:05 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164 1073741824" returned: 0 in 0.651s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Flow 'volume_create_manager' (04833be5-fabe-4844-9f23-24c5a9f6c16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a27c687-ce6d-49fb-9856-3e59f58049c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a27c687-ce6d-49fb-9856-3e59f58049c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-375102393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f09b3a1-2508-4706-b04f-4ee0b1ec7c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113b0cc71ad4a1cb447a3a793943e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:06Z,use_quota=True,user_id='b929770f4ed04a0a8a0abbccddc93ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f8cad8-a516-4240-8272-c0da247b802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f8cad8-a516-4240-8272-c0da247b802f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52a39d2-2f3f-4bbd-b039-22439a1eb7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52a39d2-2f3f-4bbd-b039-22439a1eb7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f09b3a1-2508-4706-b04f-4ee0b1ec7c87', 'volume_name': 'volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:05 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d38f6ec-e572-4381-85fd-d10b62d821ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d38f6ec-e572-4381-85fd-d10b62d821ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da40a44-ddbc-49c7-8871-971f7dadfd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:05 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume 5f09b3a1-2508-4706-b04f-4ee0b1ec7c87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87', 'volume_size': 1} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b" returned: 0 in 0.504s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:05 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b Sep 17 07:36:05 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:05 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164 Sep 17 07:36:05 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:06 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d93812a1-3b69-44f2-ad8b-db4d7828538b" returned: 0 in 0.378s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:06 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164" returned: 0 in 0.411s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-quobyte-d93812a1-3b69-44f2-ad8b-db4d7828538b" released by "delete_volume" :: held 1.014s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.301s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1579506718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee012c9d-0945-49b4-83d9-41a660fd8bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113b0cc71ad4a1cb447a3a793943e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:05Z,use_quota=True,user_id='b929770f4ed04a0a8a0abbccddc93ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Creating volume ee012c9d-0945-49b4-83d9-41a660fd8bcd {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:06 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:06 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd 1073741824 Sep 17 07:36:06 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553950c4-ba73-493a-8e14-7fb947fc3c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-079da111-bcaa-4e63-b301-9e756f14c164', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25364504-d67c-4f71-9a31-6d1365035794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Flow 'volume_create_manager' (bd007478-7c7c-4436-83b5-476a1caccb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21bcd1b-213d-47b8-9700-cbf1f14c1568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:06 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume volume-079da111-bcaa-4e63-b301-9e756f14c164 (079da111-bcaa-4e63-b301-9e756f14c164): created successfully Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25364504-d67c-4f71-9a31-6d1365035794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Flow 'volume_create_manager' (90a574be-2c9c-4f39-bb1a-b9963daff232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21bcd1b-213d-47b8-9700-cbf1f14c1568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1883169905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383411ba-becc-4a55-80ee-79387715f0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113b0cc71ad4a1cb447a3a793943e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:06Z,use_quota=True,user_id='b929770f4ed04a0a8a0abbccddc93ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8e74b0-50f5-4505-8178-8fb48cbd65b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8e74b0-50f5-4505-8178-8fb48cbd65b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16822f3b-f443-4bf2-9d64-b8c1f53b9064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16822f3b-f443-4bf2-9d64-b8c1f53b9064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383411ba-becc-4a55-80ee-79387715f0ed', 'volume_name': 'volume-383411ba-becc-4a55-80ee-79387715f0ed', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52dbe45-dc16-492f-8217-74bf5d2582ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52dbe45-dc16-492f-8217-74bf5d2582ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723079db-d0cc-49e5-bbeb-df162ae518fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:06 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume 383411ba-becc-4a55-80ee-79387715f0ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383411ba-becc-4a55-80ee-79387715f0ed', 'volume_size': 1} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:06 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-9ab83ba5-ec37-422e-83f1-5b8a129582d6 tempest-CreateVolumesFromSnapshotTest-849874723 None] Created volume successfully. Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Created reservations ['8ef9c8f3-e34f-4155-818b-e7f453ad37b9', '76bf97d7-cb5c-4728-a69e-edcf356ad13d', '725877bf-df0e-4bcd-8a60-568fad6637d5', 'fe2015f6-1d20-4272-bbf7-da9d7609ebc9'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Flow 'volume_create_manager' (928337aa-7a35-4636-9b1c-a78820f57985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78195c6-1844-4cc3-b9f2-b59973f9ff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78195c6-1844-4cc3-b9f2-b59973f9ff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1426524865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7671053f-ad8c-43a1-b37c-b7f009a2c977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113b0cc71ad4a1cb447a3a793943e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:07Z,use_quota=True,user_id='b929770f4ed04a0a8a0abbccddc93ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:06 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc601b3-a312-4ebe-8e89-6be25bd3c6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:06 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc601b3-a312-4ebe-8e89-6be25bd3c6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c46913f-f299-495d-98a2-dfe1d6a49c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c46913f-f299-495d-98a2-dfe1d6a49c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7671053f-ad8c-43a1-b37c-b7f009a2c977', 'volume_name': 'volume-7671053f-ad8c-43a1-b37c-b7f009a2c977', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395cdca0-2b77-4757-8030-46dc47b3f213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395cdca0-2b77-4757-8030-46dc47b3f213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f7e7d0-f160-435b-82a5-2e9919628283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:06 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume 7671053f-ad8c-43a1-b37c-b7f009a2c977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7671053f-ad8c-43a1-b37c-b7f009a2c977', 'volume_size': 1} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:06 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd 1073741824" returned: 0 in 0.593s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:06 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd Sep 17 07:36:06 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:06 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.281s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:06 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:06 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Deleted volume successfully. Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-53471d0f-c651-4b37-b92e-b642ab8ab398 tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-d93812a1-3b69-44f2-ad8b-db4d7828538b-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:07 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd" returned: 0 in 0.269s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.760s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-956824880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887f2998-e6e3-4331-8b6a-9cdb74a6931e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113b0cc71ad4a1cb447a3a793943e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:05Z,use_quota=True,user_id='b929770f4ed04a0a8a0abbccddc93ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Creating volume 887f2998-e6e3-4331-8b6a-9cdb74a6931e {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:07 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d06c42c-13c8-4ab7-ab59-d3574ba0f523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a231b0ba-7383-46f9-bb98-6b95931f06e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:07 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e 1073741824 Sep 17 07:36:07 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:07 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd (ee012c9d-0945-49b4-83d9-41a660fd8bcd): created successfully Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a231b0ba-7383-46f9-bb98-6b95931f06e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Flow 'volume_create_manager' (1a4bb5ef-bb48-4c04-9557-5c766c526b0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:07 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1a244541-d4b0-4315-a0e9-1143e66dab43 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Created volume successfully. Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "cinder-452ec3d4-510d-4971-a7db-f67d18972492-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-452ec3d4-510d-4971-a7db-f67d18972492-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "cinder-quobyte-452ec3d4-510d-4971-a7db-f67d18972492" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-quobyte-452ec3d4-510d-4971-a7db-f67d18972492" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[133b2be1-bd15-4f8c-a72e-6e9bc3f5b3aa]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:07 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492 Sep 17 07:36:07 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:07 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e 1073741824" returned: 0 in 0.515s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:07 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e Sep 17 07:36:07 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:07 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492" returned: 0 in 0.399s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:07 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492 Sep 17 07:36:07 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:07 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e" returned: 0 in 0.269s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.258s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-375102393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f09b3a1-2508-4706-b04f-4ee0b1ec7c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113b0cc71ad4a1cb447a3a793943e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:06Z,use_quota=True,user_id='b929770f4ed04a0a8a0abbccddc93ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Creating volume 5f09b3a1-2508-4706-b04f-4ee0b1ec7c87 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:07 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d09c76-3fe8-4a18-89e0-255efee96780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:08 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87 1073741824 Sep 17 07:36:08 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e442bb0a-7819-40c8-b917-3f4a9038e48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:08 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e (887f2998-e6e3-4331-8b6a-9cdb74a6931e): created successfully Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e442bb0a-7819-40c8-b917-3f4a9038e48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Flow 'volume_create_manager' (7896c885-ac14-43e8-b642-3ed3d71f36f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:08 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-92185736-c222-48e3-8228-b1c744140dc8 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Created volume successfully. Sep 17 07:36:08 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-452ec3d4-510d-4971-a7db-f67d18972492" returned: 0 in 0.300s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-quobyte-452ec3d4-510d-4971-a7db-f67d18972492" released by "delete_volume" :: held 0.745s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Created reservations ['dac97169-c70e-4f4c-b7a4-701360413c9e', '5cb5ad89-badc-4efc-92c5-14169a6aa173', '769f345d-d07a-4c60-9b79-b72021186fc0', '02575bab-43b1-4e77-b5bd-9b7fe353f8aa'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:08 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:08 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:08 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87 1073741824" returned: 0 in 0.434s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:08 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87 Sep 17 07:36:08 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:08 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.277s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:08 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Deleted volume successfully. Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b146cebc-bd07-4c21-9bab-c76547491ada tempest-VolumeDependencyTests-1983371398 None] Lock "cinder-452ec3d4-510d-4971-a7db-f67d18972492-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:08 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87" returned: 0 in 0.267s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.262s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1883169905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383411ba-becc-4a55-80ee-79387715f0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113b0cc71ad4a1cb447a3a793943e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:06Z,use_quota=True,user_id='b929770f4ed04a0a8a0abbccddc93ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Creating volume 383411ba-becc-4a55-80ee-79387715f0ed {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:08 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-383411ba-becc-4a55-80ee-79387715f0ed 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da40a44-ddbc-49c7-8871-971f7dadfd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:08 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-383411ba-becc-4a55-80ee-79387715f0ed 1073741824 Sep 17 07:36:08 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af33766-2965-4e5f-8b48-d6417ab14a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:08 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87 (5f09b3a1-2508-4706-b04f-4ee0b1ec7c87): created successfully Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af33766-2965-4e5f-8b48-d6417ab14a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Flow 'volume_create_manager' (04833be5-fabe-4844-9f23-24c5a9f6c16e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:08 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3c7fdc96-696e-41d0-8c1c-a3d87448303b tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Created volume successfully. Sep 17 07:36:09 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-383411ba-becc-4a55-80ee-79387715f0ed 1073741824" returned: 0 in 0.451s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-383411ba-becc-4a55-80ee-79387715f0ed {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:09 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-383411ba-becc-4a55-80ee-79387715f0ed Sep 17 07:36:09 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:09 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-383411ba-becc-4a55-80ee-79387715f0ed" returned: 0 in 0.266s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723079db-d0cc-49e5-bbeb-df162ae518fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383411ba-becc-4a55-80ee-79387715f0ed', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3806432f-1dc5-4cac-b861-352bc0245213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] Creating offline snapshot 28e8c162-8f91-40c7-8347-2b4dc5ccef8a of volume 23f8a78c-8547-41e8-a8d4-528b135f13f3 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:36:09 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume volume-383411ba-becc-4a55-80ee-79387715f0ed (383411ba-becc-4a55-80ee-79387715f0ed): created successfully Sep 17 07:36:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3806432f-1dc5-4cac-b861-352bc0245213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:09 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Flow 'volume_create_manager' (bd007478-7c7c-4436-83b5-476a1caccb00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:09 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e0411519-5d8b-40b7-9bb3-f6434c070c7a tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Created volume successfully. Sep 17 07:36:09 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0651beb6-7dcf-404a-8c40-e73b3680997e]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:09 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 Sep 17 07:36:09 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:10 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3" returned: 0 in 0.450s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:10 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a 1G Sep 17 07:36:10 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:10 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a 1G" returned: 0 in 0.425s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:10 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a Sep 17 07:36:10 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:10 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a" returned: 0 in 0.299s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:10 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a is being set with open permissions: ugo+rw Sep 17 07:36:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:10 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a Sep 17 07:36:10 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:11 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a" returned: 0 in 0.264s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:11 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.info Sep 17 07:36:11 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:11 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.info" returned: 0 in 0.258s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:11 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.info is being set with open permissions: ugo+rw Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:11 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.info Sep 17 07:36:11 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Flow 'volume_create_manager' (cd601d80-acde-45de-b70c-75cf8c22500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:11 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b2087d-d1ea-4836-930c-0baa970581c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.info" returned: 0 in 0.275s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.854s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1426524865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7671053f-ad8c-43a1-b37c-b7f009a2c977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113b0cc71ad4a1cb447a3a793943e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:07Z,use_quota=True,user_id='b929770f4ed04a0a8a0abbccddc93ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Creating volume 7671053f-ad8c-43a1-b37c-b7f009a2c977 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:11 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7671053f-ad8c-43a1-b37c-b7f009a2c977 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:11 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7671053f-ad8c-43a1-b37c-b7f009a2c977 1073741824 Sep 17 07:36:11 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b2087d-d1ea-4836-930c-0baa970581c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b8bf833-5703-404e-8a79-f3310ce8b43a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01261e1d8591452f9c5ed64e16a51328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:12Z,use_quota=True,user_id='df56696efa7f4ad0821110471f27b070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a81c3e5-e08d-4ca5-994b-6450575b3d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a81c3e5-e08d-4ca5-994b-6450575b3d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146a3a58-f799-4749-96dc-be1e14ff7606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146a3a58-f799-4749-96dc-be1e14ff7606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b8bf833-5703-404e-8a79-f3310ce8b43a', 'volume_name': 'volume-9b8bf833-5703-404e-8a79-f3310ce8b43a', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe679ef-1d81-42d1-a6c1-e0f4735e85ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe679ef-1d81-42d1-a6c1-e0f4735e85ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a84bea-139f-4b71-b78b-badafcfb712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:11 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Volume 9b8bf833-5703-404e-8a79-f3310ce8b43a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b8bf833-5703-404e-8a79-f3310ce8b43a', 'volume_size': 1} Sep 17 07:36:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:11 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-77e47242-42ec-4e41-ab8b-25dc1a82ec90 tempest-ProjectReaderTests-457785573 None] Create snapshot completed successfully Sep 17 07:36:12 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7671053f-ad8c-43a1-b37c-b7f009a2c977 1073741824" returned: 0 in 0.415s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7671053f-ad8c-43a1-b37c-b7f009a2c977 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:12 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7671053f-ad8c-43a1-b37c-b7f009a2c977 Sep 17 07:36:12 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:12 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7671053f-ad8c-43a1-b37c-b7f009a2c977" returned: 0 in 0.248s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.416s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f7e7d0-f160-435b-82a5-2e9919628283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7671053f-ad8c-43a1-b37c-b7f009a2c977', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a6d2af-ca51-4961-8de8-0208d54584a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] Creating offline snapshot c985f338-e49c-41e8-9ea8-7f826f9eaedc of volume 079da111-bcaa-4e63-b301-9e756f14c164 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:36:12 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Volume volume-7671053f-ad8c-43a1-b37c-b7f009a2c977 (7671053f-ad8c-43a1-b37c-b7f009a2c977): created successfully Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a6d2af-ca51-4961-8de8-0208d54584a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Flow 'volume_create_manager' (928337aa-7a35-4636-9b1c-a78820f57985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e982d2d9-0878-42c5-84bc-0bb569a9c275]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:12 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8814683d-4159-40a2-bac7-39fe9d2cc3c3 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Created volume successfully. Sep 17 07:36:12 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164 Sep 17 07:36:12 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-28e8c162-8f91-40c7-8347-2b4dc5ccef8a-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Lock "cinder-28e8c162-8f91-40c7-8347-2b4dc5ccef8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-23f8a78c-8547-41e8-a8d4-528b135f13f3" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-23f8a78c-8547-41e8-a8d4-528b135f13f3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-28e8c162-8f91-40c7-8347-2b4dc5ccef8a" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-28e8c162-8f91-40c7-8347-2b4dc5ccef8a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Deleting offline snapshot 28e8c162-8f91-40c7-8347-2b4dc5ccef8a of volume 23f8a78c-8547-41e8-a8d4-528b135f13f3 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:36:12 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] snapshot_file for this snap is: volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164" returned: 0 in 0.401s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50ed7c6-232b-43ae-acfa-fd2d286dd04d]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:12 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc 1G Sep 17 07:36:12 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:12 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a Sep 17 07:36:12 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:13 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a" returned: 0 in 0.435s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23f8a78c-8547-41e8-a8d4-528b135f13f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2662c478-df04-415c-9fd6-279ca7743071]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:13 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc 1G" returned: 0 in 0.498s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079da111-bcaa-4e63-b301-9e756f14c164 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "cinder-7671053f-ad8c-43a1-b37c-b7f009a2c977-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:13 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079da111-bcaa-4e63-b301-9e756f14c164 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc Sep 17 07:36:13 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-7671053f-ad8c-43a1-b37c-b7f009a2c977-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "cinder-quobyte-7671053f-ad8c-43a1-b37c-b7f009a2c977" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-quobyte-7671053f-ad8c-43a1-b37c-b7f009a2c977" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf02212-46e2-41a2-a16e-2dbc66a796c4]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7671053f-ad8c-43a1-b37c-b7f009a2c977 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:13 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 Sep 17 07:36:13 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:13 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7671053f-ad8c-43a1-b37c-b7f009a2c977 Sep 17 07:36:13 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:13 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079da111-bcaa-4e63-b301-9e756f14c164 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc" returned: 0 in 0.336s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:13 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc is being set with open permissions: ugo+rw Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:13 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc Sep 17 07:36:13 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:13 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3" returned: 0 in 0.456s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:13 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a Sep 17 07:36:13 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:13 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7671053f-ad8c-43a1-b37c-b7f009a2c977" returned: 0 in 0.408s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7671053f-ad8c-43a1-b37c-b7f009a2c977 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:13 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7671053f-ad8c-43a1-b37c-b7f009a2c977 Sep 17 07:36:13 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:13 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc" returned: 0 in 0.278s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:13 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.info Sep 17 07:36:13 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:14 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7671053f-ad8c-43a1-b37c-b7f009a2c977" returned: 0 in 0.261s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:14 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a" returned: 0 in 0.373s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-quobyte-7671053f-ad8c-43a1-b37c-b7f009a2c977" released by "delete_volume" :: held 0.739s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:14 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a Sep 17 07:36:14 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Created reservations ['c69cb67e-4c5d-403d-818e-ea068c1fa014', 'f6142e18-8152-42bf-95de-db5e049c0385', '5e72965f-6288-4967-bc01-8c37b63fb488', 'dd16a8c2-f79b-40a7-8be6-0f2405c90e61'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:14 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.info" returned: 0 in 0.319s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:14 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.info is being set with open permissions: ugo+rw Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:14 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:14 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:14 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.info Sep 17 07:36:14 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:14 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3.28e8c162-8f91-40c7-8347-2b4dc5ccef8a" returned: 0 in 0.273s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-28e8c162-8f91-40c7-8347-2b4dc5ccef8a" released by "_delete_snapshot" :: held 1.658s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-23f8a78c-8547-41e8-a8d4-528b135f13f3" released by "delete_snapshot" :: held 1.683s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "cinder-383411ba-becc-4a55-80ee-79387715f0ed-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:14 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.277s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:14 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Deleted volume successfully. Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Created reservations ['fe3f609b-8c30-42bd-86b2-ff8a683d9474', '7fded0ef-3c65-44b4-ad2a-1e0068ea3194', '221f2ada-dc41-4e4d-9755-b3c8e5ffecdc', '99efea29-d39e-4402-a587-9123c4331035'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:14 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.info" returned: 0 in 0.287s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-383411ba-becc-4a55-80ee-79387715f0ed-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.884s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b8bf833-5703-404e-8a79-f3310ce8b43a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01261e1d8591452f9c5ed64e16a51328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:12Z,use_quota=True,user_id='df56696efa7f4ad0821110471f27b070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Creating volume 9b8bf833-5703-404e-8a79-f3310ce8b43a {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:14 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9b8bf833-5703-404e-8a79-f3310ce8b43a 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:14 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9b8bf833-5703-404e-8a79-f3310ce8b43a 1073741824 Sep 17 07:36:14 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3ce7c91f-5314-4c00-a30d-447e3d0cbd16 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-7671053f-ad8c-43a1-b37c-b7f009a2c977-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:14 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1e37539d-362e-464f-9ade-a8336304d679 tempest-CreateVolumesFromSnapshotTest-849874723 None] Create snapshot completed successfully Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "cinder-quobyte-383411ba-becc-4a55-80ee-79387715f0ed" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-quobyte-383411ba-becc-4a55-80ee-79387715f0ed" acquired by "delete_volume" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:14 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Delete snapshot completed successfully. Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-635522f4-4353-456c-83ca-8b54c534aa90 tempest-ProjectReaderTests-457785573 None] Lock "cinder-28e8c162-8f91-40c7-8347-2b4dc5ccef8a-delete_snapshot" released by "delete_snapshot" :: held 1.989s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[32731e66-3557-4d23-a1fb-f429571d532a]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-383411ba-becc-4a55-80ee-79387715f0ed {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:14 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-383411ba-becc-4a55-80ee-79387715f0ed Sep 17 07:36:14 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-23f8a78c-8547-41e8-a8d4-528b135f13f3-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Lock "cinder-23f8a78c-8547-41e8-a8d4-528b135f13f3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-23f8a78c-8547-41e8-a8d4-528b135f13f3" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-23f8a78c-8547-41e8-a8d4-528b135f13f3" acquired by "delete_volume" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f133069-010c-4c93-9563-420dd71ffdb0]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:15 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9b8bf833-5703-404e-8a79-f3310ce8b43a 1073741824" returned: 0 in 0.528s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:15 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-383411ba-becc-4a55-80ee-79387715f0ed" returned: 0 in 0.408s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-383411ba-becc-4a55-80ee-79387715f0ed {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:15 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 Sep 17 07:36:15 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:15 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-383411ba-becc-4a55-80ee-79387715f0ed Sep 17 07:36:15 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9b8bf833-5703-404e-8a79-f3310ce8b43a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:15 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9b8bf833-5703-404e-8a79-f3310ce8b43a Sep 17 07:36:15 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:15 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-383411ba-becc-4a55-80ee-79387715f0ed" returned: 0 in 0.291s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-quobyte-383411ba-becc-4a55-80ee-79387715f0ed" released by "delete_volume" :: held 0.747s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:15 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9b8bf833-5703-404e-8a79-f3310ce8b43a" returned: 0 in 0.282s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:15 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a84bea-139f-4b71-b78b-badafcfb712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b8bf833-5703-404e-8a79-f3310ce8b43a', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e260357-097d-49e3-86cc-35a111c0e5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3" returned: 0 in 0.474s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:15 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Volume volume-9b8bf833-5703-404e-8a79-f3310ce8b43a (9b8bf833-5703-404e-8a79-f3310ce8b43a): created successfully Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e260357-097d-49e3-86cc-35a111c0e5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:15 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3 Sep 17 07:36:15 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Flow 'volume_create_manager' (cd601d80-acde-45de-b70c-75cf8c22500f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:15 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-318e196a-4a8f-42f2-a9db-15d0011823af tempest-CinderUnicodeTest-210503487 None] Created volume successfully. Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Created reservations ['e7e01c2f-0be8-4373-a4a2-bb07b105f5b3', '6ed6bd19-f2d9-43a0-a639-a0539cec3534', 'edf996aa-a9b7-4e9f-ad28-0e132a68ec99', '36221393-ff24-43b0-9ff7-fe0ed6e108ce'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:15 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:15 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:15 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "cinder-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23f8a78c-8547-41e8-a8d4-528b135f13f3" returned: 0 in 0.374s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Flow 'volume_create_manager' (e893b7ef-48a1-4adb-860f-ca2be69ab076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b938cff-d068-49ef-8dbd-2fc3b47ae667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-23f8a78c-8547-41e8-a8d4-528b135f13f3" released by "delete_volume" :: held 0.981s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b938cff-d068-49ef-8dbd-2fc3b47ae667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-244980547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c90987-64ad-4ca3-b2e8-2571109aee62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5553294d6aa04276809e4bd71db7504d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:16Z,use_quota=True,user_id='e6dfd475ccfc4de4ac9a70875f9e7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae18fb0-f4c4-46dc-9948-59ab2982f1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:16 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae18fb0-f4c4-46dc-9948-59ab2982f1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e476cdc0-ccfb-4561-b7d0-ce6619e4ff89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e476cdc0-ccfb-4561-b7d0-ce6619e4ff89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c90987-64ad-4ca3-b2e8-2571109aee62', 'volume_name': 'volume-95c90987-64ad-4ca3-b2e8-2571109aee62', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd7f704-848b-480f-b5cd-bdd571427a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd7f704-848b-480f-b5cd-bdd571427a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8e9be1-d8e9-4772-ba74-815fec0bfc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:16 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume 95c90987-64ad-4ca3-b2e8-2571109aee62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c90987-64ad-4ca3-b2e8-2571109aee62', 'volume_size': 1} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-244980547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c90987-64ad-4ca3-b2e8-2571109aee62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5553294d6aa04276809e4bd71db7504d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:16Z,use_quota=True,user_id='e6dfd475ccfc4de4ac9a70875f9e7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Creating volume 95c90987-64ad-4ca3-b2e8-2571109aee62 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:16 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-95c90987-64ad-4ca3-b2e8-2571109aee62 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.398s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:16 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Deleted volume successfully. Sep 17 07:36:16 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-95c90987-64ad-4ca3-b2e8-2571109aee62 1073741824 Sep 17 07:36:16 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "cinder-quobyte-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e3073fa7-0a17-4d22-bb0e-57707be8be61 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-383411ba-becc-4a55-80ee-79387715f0ed-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-quobyte-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87" acquired by "delete_volume" :: waited 0.060s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Created reservations ['be6f689e-f6f7-435a-b495-ca93c7f972e4', '8ff80468-2342-4b1a-8ab3-4c9b29775f39', '8566860d-a089-4eb6-98f7-08bad8024d14', '09f2f9e6-9a1d-46d3-9f33-ad25f11db162'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4988360-70bc-4115-a1ad-bc33075868a7]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:16 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:16 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:16 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87 Sep 17 07:36:16 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Flow 'volume_create_manager' (c4e113fe-ba35-43b7-852e-2478ea90322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876ddbab-8c70-4660-9dfa-6b26e4d81d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876ddbab-8c70-4660-9dfa-6b26e4d81d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1000369842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10985bd-584d-492c-bad7-dbcf3a7430b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5553294d6aa04276809e4bd71db7504d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:16Z,use_quota=True,user_id='e6dfd475ccfc4de4ac9a70875f9e7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7f1a85-33fc-42c4-88e2-5c27b2222f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7f1a85-33fc-42c4-88e2-5c27b2222f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4062026d-61cf-4f47-8f48-7249a306283c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:16 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4062026d-61cf-4f47-8f48-7249a306283c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a10985bd-584d-492c-bad7-dbcf3a7430b8', 'volume_name': 'volume-a10985bd-584d-492c-bad7-dbcf3a7430b8', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80928afa-da2c-4a18-b619-e8bc993fd91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80928afa-da2c-4a18-b619-e8bc993fd91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7eb96b0-e0a6-4694-83d5-3df719dd44d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:16 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume a10985bd-584d-492c-bad7-dbcf3a7430b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a10985bd-584d-492c-bad7-dbcf3a7430b8', 'volume_size': 1} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.347s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:16 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Deleted volume successfully. Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-6f67456f-4f28-42cc-8133-b2182a9af152 tempest-ProjectReaderTests-457785573 None] Lock "cinder-23f8a78c-8547-41e8-a8d4-528b135f13f3-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:16 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-95c90987-64ad-4ca3-b2e8-2571109aee62 1073741824" returned: 0 in 0.707s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-95c90987-64ad-4ca3-b2e8-2571109aee62 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:16 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-95c90987-64ad-4ca3-b2e8-2571109aee62 Sep 17 07:36:16 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Flow 'volume_create_manager' (d61bee58-2bf6-43ad-b31a-13410f80287c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:16 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41db0642-9789-455f-acc8-d749778cde4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87" returned: 0 in 0.775s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41db0642-9789-455f-acc8-d749778cde4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1516144789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716c40a7-10d2-4b78-8095-02fb7effc7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01261e1d8591452f9c5ed64e16a51328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:17Z,use_quota=True,user_id='df56696efa7f4ad0821110471f27b070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5f1fb0-4ba6-448d-8282-5e7e38724286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5f1fb0-4ba6-448d-8282-5e7e38724286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e49049-edfd-465d-87a0-3d3ec3e1ae1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e49049-edfd-465d-87a0-3d3ec3e1ae1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '716c40a7-10d2-4b78-8095-02fb7effc7b4', 'volume_name': 'volume-716c40a7-10d2-4b78-8095-02fb7effc7b4', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554e7a52-7eb0-49b6-ba30-7eaebd6ebe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554e7a52-7eb0-49b6-ba30-7eaebd6ebe5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:17 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87 Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1370fa4-e130-45d4-b777-dbf88ffb258f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:17 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Volume 716c40a7-10d2-4b78-8095-02fb7effc7b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-716c40a7-10d2-4b78-8095-02fb7effc7b4', 'volume_size': 1} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:17 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-95c90987-64ad-4ca3-b2e8-2571109aee62" returned: 0 in 0.305s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.504s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1000369842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10985bd-584d-492c-bad7-dbcf3a7430b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5553294d6aa04276809e4bd71db7504d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:16Z,use_quota=True,user_id='e6dfd475ccfc4de4ac9a70875f9e7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Creating volume a10985bd-584d-492c-bad7-dbcf3a7430b8 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:17 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a10985bd-584d-492c-bad7-dbcf3a7430b8 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:17 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a10985bd-584d-492c-bad7-dbcf3a7430b8 1073741824 Sep 17 07:36:17 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8e9be1-d8e9-4772-ba74-815fec0bfc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c90987-64ad-4ca3-b2e8-2571109aee62', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8cd5cb-e55b-416a-8629-4b5a349a3b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Flow 'volume_create_manager' (7a97de25-4a49-48a0-8798-e4c52b72e53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b60e69-391e-4f4b-9aaa-d06a5d1abd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume volume-95c90987-64ad-4ca3-b2e8-2571109aee62 (95c90987-64ad-4ca3-b2e8-2571109aee62): created successfully Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8cd5cb-e55b-416a-8629-4b5a349a3b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Flow 'volume_create_manager' (e893b7ef-48a1-4adb-860f-ca2be69ab076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b60e69-391e-4f4b-9aaa-d06a5d1abd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2046764169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2313aeee-ccdd-49ac-8be5-b9523da1409d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5553294d6aa04276809e4bd71db7504d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:17Z,use_quota=True,user_id='e6dfd475ccfc4de4ac9a70875f9e7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0ef068-ca0d-4af2-a745-6514cfd6a321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0ef068-ca0d-4af2-a745-6514cfd6a321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a87d0bc-4a55-45cf-9140-83fe2edbb16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a87d0bc-4a55-45cf-9140-83fe2edbb16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2313aeee-ccdd-49ac-8be5-b9523da1409d', 'volume_name': 'volume-2313aeee-ccdd-49ac-8be5-b9523da1409d', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752f1813-3eec-4594-a86f-d2d2ffe572a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752f1813-3eec-4594-a86f-d2d2ffe572a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfbd267-20cd-46b0-8cba-94a90f801d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume 2313aeee-ccdd-49ac-8be5-b9523da1409d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2313aeee-ccdd-49ac-8be5-b9523da1409d', 'volume_size': 1} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:17 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-c3602403-3b57-4dac-b129-65c69f651ad8 tempest-CreateVolumesFromSnapshotTest-849874723 None] Created volume successfully. Sep 17 07:36:17 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87" returned: 0 in 0.393s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-quobyte-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87" released by "delete_volume" :: held 1.237s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Created reservations ['4b3fa7cb-438b-471b-a180-761b2cb01f18', '9b2e2880-0262-4b94-a0a6-23826df7a1fe', 'b72e7757-4ef2-4f29-97d1-9d96aa792e4c', 'ece8292a-f7ba-4d7a-9638-7afe80d4f556'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:17 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:17 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Flow 'volume_create_manager' (ba7e3d4a-c113-4b3e-8e7d-42e7042f9043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb1b140-03db-4d45-852c-31da7809cf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb1b140-03db-4d45-852c-31da7809cf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-404233026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26bb4653-e7c4-4448-bba0-f3fb27f34d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5553294d6aa04276809e4bd71db7504d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:18Z,use_quota=True,user_id='e6dfd475ccfc4de4ac9a70875f9e7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0422a19f-f454-42e2-8320-d124eed03c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0422a19f-f454-42e2-8320-d124eed03c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60794f4e-94a5-44c4-bed7-ed7b57164454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60794f4e-94a5-44c4-bed7-ed7b57164454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26bb4653-e7c4-4448-bba0-f3fb27f34d12', 'volume_name': 'volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4aecb97-b186-4e3e-8edf-6c5e9cdd2f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4aecb97-b186-4e3e-8edf-6c5e9cdd2f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369e65e7-c6d6-407c-ab29-89a65869cc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:17 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume 26bb4653-e7c4-4448-bba0-f3fb27f34d12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12', 'volume_size': 1} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a10985bd-584d-492c-bad7-dbcf3a7430b8 1073741824" returned: 0 in 0.745s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:17 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.365s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:17 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Deleted volume successfully. Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-272c306c-5016-4abf-8e0e-df742696c918 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-5f09b3a1-2508-4706-b04f-4ee0b1ec7c87-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a10985bd-584d-492c-bad7-dbcf3a7430b8 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:17 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a10985bd-584d-492c-bad7-dbcf3a7430b8 Sep 17 07:36:17 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:18 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a10985bd-584d-492c-bad7-dbcf3a7430b8" returned: 0 in 0.286s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.203s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1516144789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716c40a7-10d2-4b78-8095-02fb7effc7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01261e1d8591452f9c5ed64e16a51328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:17Z,use_quota=True,user_id='df56696efa7f4ad0821110471f27b070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Creating volume 716c40a7-10d2-4b78-8095-02fb7effc7b4 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:18 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "cinder-887f2998-e6e3-4331-8b6a-9cdb74a6931e-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:18 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 1073741824 Sep 17 07:36:18 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7eb96b0-e0a6-4694-83d5-3df719dd44d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a10985bd-584d-492c-bad7-dbcf3a7430b8', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c94e488-de63-4ec6-8bcd-6d808bd74f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-887f2998-e6e3-4331-8b6a-9cdb74a6931e-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:18 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume volume-a10985bd-584d-492c-bad7-dbcf3a7430b8 (a10985bd-584d-492c-bad7-dbcf3a7430b8): created successfully Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c94e488-de63-4ec6-8bcd-6d808bd74f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Flow 'volume_create_manager' (c4e113fe-ba35-43b7-852e-2478ea90322b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Flow 'volume_create_manager' (0e8aa2fd-001c-43bf-95df-437f04649d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43aee39d-a046-40de-8134-9efb06181f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Flow 'volume_create_manager' (420fdfb5-71d8-4d04-b47c-209903a6d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7c0d4c-bc0f-4e89-a643-a5730954a773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:18 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d46e91f2-3c7b-44d4-a8ad-9442cd261f82 tempest-CreateVolumesFromSnapshotTest-849874723 None] Created volume successfully. Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43aee39d-a046-40de-8134-9efb06181f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-313366129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf7f188-ce25-4aa3-af49-a4bddc3043dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe5224828af419d9d43f2eaa0fa021e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:18Z,use_quota=True,user_id='06328113b44e4c4084658b9ffaba06c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe925c90-fbf8-4a1d-bf75-5c5221169dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe925c90-fbf8-4a1d-bf75-5c5221169dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3da3449-3515-421d-b6fe-f6d6ef13fa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3da3449-3515-421d-b6fe-f6d6ef13fa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cf7f188-ce25-4aa3-af49-a4bddc3043dd', 'volume_name': 'volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0059a4d3-82cf-4626-89da-5ff6a2ad8122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0059a4d3-82cf-4626-89da-5ff6a2ad8122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9181e5fa-84ae-49e8-a8cd-690831413f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:18 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Volume 7cf7f188-ce25-4aa3-af49-a4bddc3043dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd', 'volume_size': 1} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7c0d4c-bc0f-4e89-a643-a5730954a773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2050289169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddaffcd1-b268-4298-925a-df19f217f0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5553294d6aa04276809e4bd71db7504d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:18Z,use_quota=True,user_id='e6dfd475ccfc4de4ac9a70875f9e7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9f8eac-b86f-452b-bc96-42147da5c5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9f8eac-b86f-452b-bc96-42147da5c5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a24eb06-78d7-49a4-be57-2ed1e4fa1964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a24eb06-78d7-49a4-be57-2ed1e4fa1964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddaffcd1-b268-4298-925a-df19f217f0ec', 'volume_name': 'volume-ddaffcd1-b268-4298-925a-df19f217f0ec', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e51456-41dd-4da3-9d45-3f070936a6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e51456-41dd-4da3-9d45-3f070936a6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448cba74-387d-4b25-a3b5-453a4fea924e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:18 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume ddaffcd1-b268-4298-925a-df19f217f0ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddaffcd1-b268-4298-925a-df19f217f0ec', 'volume_size': 1} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "cinder-quobyte-887f2998-e6e3-4331-8b6a-9cdb74a6931e" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-quobyte-887f2998-e6e3-4331-8b6a-9cdb74a6931e" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85570f2-d2cc-485e-a3be-51c98b6cbe0b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:18 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 1073741824" returned: 0 in 0.459s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:18 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e Sep 17 07:36:18 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:18 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 Sep 17 07:36:18 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:19 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e" returned: 0 in 0.406s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:19 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4" returned: 0 in 0.284s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:19 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e Sep 17 07:36:19 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.721s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2046764169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2313aeee-ccdd-49ac-8be5-b9523da1409d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5553294d6aa04276809e4bd71db7504d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:17Z,use_quota=True,user_id='e6dfd475ccfc4de4ac9a70875f9e7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Creating volume 2313aeee-ccdd-49ac-8be5-b9523da1409d {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:19 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2313aeee-ccdd-49ac-8be5-b9523da1409d 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1370fa4-e130-45d4-b777-dbf88ffb258f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-716c40a7-10d2-4b78-8095-02fb7effc7b4', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364e4abf-f7f3-415b-a04e-fd1323215997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:19 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2313aeee-ccdd-49ac-8be5-b9523da1409d 1073741824 Sep 17 07:36:19 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:19 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Volume volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 (716c40a7-10d2-4b78-8095-02fb7effc7b4): created successfully Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364e4abf-f7f3-415b-a04e-fd1323215997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Flow 'volume_create_manager' (d61bee58-2bf6-43ad-b31a-13410f80287c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:19 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3342d4ff-72b3-413f-bbb8-aa1ddf8495de tempest-CinderUnicodeTest-210503487 None] Created volume successfully. Sep 17 07:36:19 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-887f2998-e6e3-4331-8b6a-9cdb74a6931e" returned: 0 in 0.295s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-quobyte-887f2998-e6e3-4331-8b6a-9cdb74a6931e" released by "delete_volume" :: held 0.743s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Created reservations ['4cf2b769-b452-4492-9f42-ff92afcad6f6', 'bd8b2e8b-0181-4291-8ea4-891065d02599', '69624054-c56f-4569-b912-11602f09b85c', 'a4737c8d-95b0-4850-91e0-b3d5a586f670'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:19 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:19 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:19 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2313aeee-ccdd-49ac-8be5-b9523da1409d 1073741824" returned: 0 in 0.451s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2313aeee-ccdd-49ac-8be5-b9523da1409d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:19 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2313aeee-ccdd-49ac-8be5-b9523da1409d Sep 17 07:36:19 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:19 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.259s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:19 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Deleted volume successfully. Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-141a17b8-8179-4e32-9741-1d11130e43e6 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-887f2998-e6e3-4331-8b6a-9cdb74a6931e-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:19 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2313aeee-ccdd-49ac-8be5-b9523da1409d" returned: 0 in 0.269s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.922s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-404233026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26bb4653-e7c4-4448-bba0-f3fb27f34d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5553294d6aa04276809e4bd71db7504d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:18Z,use_quota=True,user_id='e6dfd475ccfc4de4ac9a70875f9e7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Creating volume 26bb4653-e7c4-4448-bba0-f3fb27f34d12 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:19 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfbd267-20cd-46b0-8cba-94a90f801d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2313aeee-ccdd-49ac-8be5-b9523da1409d', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:19 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12 1073741824 Sep 17 07:36:19 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf0ac60-37ec-4313-bfd2-5496d1eb581c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:19 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume volume-2313aeee-ccdd-49ac-8be5-b9523da1409d (2313aeee-ccdd-49ac-8be5-b9523da1409d): created successfully Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf0ac60-37ec-4313-bfd2-5496d1eb581c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:19 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Flow 'volume_create_manager' (7a97de25-4a49-48a0-8798-e4c52b72e53d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:19 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2f5f68cd-5a30-4172-8ede-2f80c3b4f529 tempest-CreateVolumesFromSnapshotTest-849874723 None] Created volume successfully. Sep 17 07:36:20 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12 1073741824" returned: 0 in 0.509s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:20 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12 Sep 17 07:36:20 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "cinder-ee012c9d-0945-49b4-83d9-41a660fd8bcd-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-ee012c9d-0945-49b4-83d9-41a660fd8bcd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "cinder-quobyte-ee012c9d-0945-49b4-83d9-41a660fd8bcd" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-quobyte-ee012c9d-0945-49b4-83d9-41a660fd8bcd" acquired by "delete_volume" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02b3aa3-d3ec-4e73-8042-ec4c4a1f0312]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:20 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12" returned: 0 in 0.268s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.142s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-313366129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf7f188-ce25-4aa3-af49-a4bddc3043dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe5224828af419d9d43f2eaa0fa021e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:18Z,use_quota=True,user_id='06328113b44e4c4084658b9ffaba06c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Creating volume 7cf7f188-ce25-4aa3-af49-a4bddc3043dd {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:20 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369e65e7-c6d6-407c-ab29-89a65869cc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:20 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd 1073741824 Sep 17 07:36:20 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074d3269-4bea-4d57-b2fe-978d37b3dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:20 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12 (26bb4653-e7c4-4448-bba0-f3fb27f34d12): created successfully Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074d3269-4bea-4d57-b2fe-978d37b3dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:20 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Flow 'volume_create_manager' (ba7e3d4a-c113-4b3e-8e7d-42e7042f9043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:20 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd Sep 17 07:36:20 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:20 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2cf7f5b5-6247-4cea-8530-bc505c47d3b2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Created volume successfully. Sep 17 07:36:21 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd" returned: 0 in 0.391s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:21 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd Sep 17 07:36:21 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:21 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd 1073741824" returned: 0 in 0.480s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:21 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd Sep 17 07:36:21 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:21 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ee012c9d-0945-49b4-83d9-41a660fd8bcd" returned: 0 in 0.261s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-quobyte-ee012c9d-0945-49b4-83d9-41a660fd8bcd" released by "delete_volume" :: held 0.696s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Created reservations ['15400e14-0b34-484d-8d8d-fa866ac6e60b', '7bf7bb7e-f420-4566-8adb-163085e237ab', 'e3bbe381-02f7-4d6c-a843-d2e07746e442', '6a975c69-169e-4180-8810-f215f3549d9e'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:21 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:21 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd" returned: 0 in 0.279s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:21 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.900s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2050289169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddaffcd1-b268-4298-925a-df19f217f0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5553294d6aa04276809e4bd71db7504d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:18Z,use_quota=True,user_id='e6dfd475ccfc4de4ac9a70875f9e7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Creating volume ddaffcd1-b268-4298-925a-df19f217f0ec {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:21 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ddaffcd1-b268-4298-925a-df19f217f0ec 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9181e5fa-84ae-49e8-a8cd-690831413f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae74b221-71e3-4388-a658-8ffcefe085ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:21 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ddaffcd1-b268-4298-925a-df19f217f0ec 1073741824 Sep 17 07:36:21 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:21 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Volume volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd (7cf7f188-ce25-4aa3-af49-a4bddc3043dd): created successfully Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae74b221-71e3-4388-a658-8ffcefe085ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Flow 'volume_create_manager' (0e8aa2fd-001c-43bf-95df-437f04649d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:21 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-74b01b1d-63bb-48b9-959c-cd6e75cf38d1 tempest-ProjectReaderTests-457785573 None] Created volume successfully. Sep 17 07:36:21 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "cinder-89bf9528-27c1-403a-8c32-3f5375eda767-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.298s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:21 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Deleted volume successfully. Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-89bf9528-27c1-403a-8c32-3f5375eda767-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7e19e0b6-959e-402f-9bc4-fd519f6a36a2 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-ee012c9d-0945-49b4-83d9-41a660fd8bcd-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "cinder-quobyte-89bf9528-27c1-403a-8c32-3f5375eda767" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-quobyte-89bf9528-27c1-403a-8c32-3f5375eda767" acquired by "delete_volume" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[34162980-cef4-4968-86ef-4a4048af6a0f]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-89bf9528-27c1-403a-8c32-3f5375eda767 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:21 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-89bf9528-27c1-403a-8c32-3f5375eda767 Sep 17 07:36:22 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:22 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ddaffcd1-b268-4298-925a-df19f217f0ec 1073741824" returned: 0 in 0.563s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ddaffcd1-b268-4298-925a-df19f217f0ec {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:22 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ddaffcd1-b268-4298-925a-df19f217f0ec Sep 17 07:36:22 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:22 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-89bf9528-27c1-403a-8c32-3f5375eda767" returned: 0 in 0.435s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-89bf9528-27c1-403a-8c32-3f5375eda767 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:22 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-89bf9528-27c1-403a-8c32-3f5375eda767 Sep 17 07:36:22 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:22 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ddaffcd1-b268-4298-925a-df19f217f0ec" returned: 0 in 0.321s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.075s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] Creating offline snapshot 5a36858f-1102-4f53-ae93-a0e8d6ef2113 of volume 716c40a7-10d2-4b78-8095-02fb7effc7b4 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448cba74-387d-4b25-a3b5-453a4fea924e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddaffcd1-b268-4298-925a-df19f217f0ec', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27eab70d-02d3-4d86-8934-5d2460fbda82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e8656b-5b25-4e87-aa14-feaa34ba75a5]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:22 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Volume volume-ddaffcd1-b268-4298-925a-df19f217f0ec (ddaffcd1-b268-4298-925a-df19f217f0ec): created successfully Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27eab70d-02d3-4d86-8934-5d2460fbda82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Flow 'volume_create_manager' (420fdfb5-71d8-4d04-b47c-209903a6d22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:22 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-287a98a8-4573-4b90-89ff-7bbe3eb92db2 tempest-CreateVolumesFromSnapshotTest-849874723 None] Created volume successfully. Sep 17 07:36:22 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-89bf9528-27c1-403a-8c32-3f5375eda767" returned: 0 in 0.281s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-quobyte-89bf9528-27c1-403a-8c32-3f5375eda767" released by "delete_volume" :: held 0.762s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:22 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 Sep 17 07:36:22 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Created reservations ['849b1112-be34-45a0-8f23-f69eb88b97ae', '3b6b00b0-c218-494a-a6d5-51f96dc97ac0', '0865baf2-ef62-46d7-9508-a0ed9ae10f8d', '5f246f79-c9aa-4fa7-a103-d3e03b9e9afd'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:22 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:22 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:22 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4" returned: 0 in 0.423s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:22 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 1G Sep 17 07:36:22 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:22 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.271s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:23 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Deleted volume successfully. Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b697723b-fa9d-4737-97c6-185c5eb409b5 tempest-CreateVolumesFromSourceVolumeTest-898247664 None] Lock "cinder-89bf9528-27c1-403a-8c32-3f5375eda767-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:23 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 1G" returned: 0 in 0.420s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:23 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 Sep 17 07:36:23 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:23 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113" returned: 0 in 0.332s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:23 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 is being set with open permissions: ugo+rw Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:23 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 Sep 17 07:36:23 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-ddaffcd1-b268-4298-925a-df19f217f0ec-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-ddaffcd1-b268-4298-925a-df19f217f0ec-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-quobyte-ddaffcd1-b268-4298-925a-df19f217f0ec" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-ddaffcd1-b268-4298-925a-df19f217f0ec" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb9e004-a542-4328-ac4f-1d1b3400d16f]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ddaffcd1-b268-4298-925a-df19f217f0ec {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:23 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113" returned: 0 in 0.294s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:23 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ddaffcd1-b268-4298-925a-df19f217f0ec Sep 17 07:36:23 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:24 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.info Sep 17 07:36:24 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:24 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:24 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.info" returned: 0 in 0.280s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ddaffcd1-b268-4298-925a-df19f217f0ec" returned: 0 in 0.422s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:24 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.info is being set with open permissions: ugo+rw Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ddaffcd1-b268-4298-925a-df19f217f0ec {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:24 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.info Sep 17 07:36:24 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:24 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ddaffcd1-b268-4298-925a-df19f217f0ec Sep 17 07:36:24 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:24 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.info" returned: 0 in 0.275s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.084s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:24 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ddaffcd1-b268-4298-925a-df19f217f0ec" returned: 0 in 0.315s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] Creating offline snapshot 2746b3e6-2a4b-447d-97e3-672974f0fab1 of volume 7cf7f188-ce25-4aa3-af49-a4bddc3043dd {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-ddaffcd1-b268-4298-925a-df19f217f0ec" released by "delete_volume" :: held 0.814s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:24 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-69ad3287-eaa4-4cd8-a21c-0530bae6dcfd tempest-CinderUnicodeTest-210503487 None] Create snapshot completed successfully Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c9eb25-f857-42fd-bc2f-51e7354b08e5]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Created reservations ['e3cb02ae-8408-4f5c-a241-e95d48a5084a', 'a9522c0a-74f2-4a19-b2f2-1e6ca406d7e6', '9fd19965-636b-4524-b6bf-41e9abc12272', 'c2a25294-e223-4d00-bbc4-f56ccdd957ca'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:24 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd Sep 17 07:36:24 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:24 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:24 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:24 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-26bb4653-e7c4-4448-bba0-f3fb27f34d12-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-26bb4653-e7c4-4448-bba0-f3fb27f34d12-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-quobyte-26bb4653-e7c4-4448-bba0-f3fb27f34d12" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:25 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd" returned: 0 in 0.460s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-26bb4653-e7c4-4448-bba0-f3fb27f34d12" acquired by "delete_volume" :: waited 0.030s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:25 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:25 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 1G Sep 17 07:36:25 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.351s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:25 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Deleted volume successfully. Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dc2803-de59-4f74-9926-f8e9c623ad24]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-99984b5a-2ccb-4714-b33a-6565f67be25e tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-ddaffcd1-b268-4298-925a-df19f217f0ec-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:25 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12 Sep 17 07:36:25 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:25 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 1G" returned: 0 in 0.495s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:25 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12" returned: 0 in 0.440s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:25 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 Sep 17 07:36:25 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:25 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12 Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Acquiring lock "cinder-5a36858f-1102-4f53-ae93-a0e8d6ef2113-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:25 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Lock "cinder-5a36858f-1102-4f53-ae93-a0e8d6ef2113-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Acquiring lock "cinder-quobyte-716c40a7-10d2-4b78-8095-02fb7effc7b4" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Lock "cinder-quobyte-716c40a7-10d2-4b78-8095-02fb7effc7b4" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Acquiring lock "cinder-quobyte-5a36858f-1102-4f53-ae93-a0e8d6ef2113" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Lock "cinder-quobyte-5a36858f-1102-4f53-ae93-a0e8d6ef2113" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Deleting offline snapshot 5a36858f-1102-4f53-ae93-a0e8d6ef2113 of volume 716c40a7-10d2-4b78-8095-02fb7effc7b4 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] snapshot_file for this snap is: volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[175da64b-2f64-4af7-ba9c-fe193918232c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:25 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 Sep 17 07:36:25 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:25 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-26bb4653-e7c4-4448-bba0-f3fb27f34d12" returned: 0 in 0.360s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:25 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1" returned: 0 in 0.390s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:26 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 is being set with open permissions: ugo+rw Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-26bb4653-e7c4-4448-bba0-f3fb27f34d12" released by "delete_volume" :: held 0.879s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:26 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 Sep 17 07:36:26 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Created reservations ['32d1fad3-cf87-49e4-b5ea-26936f71823d', '00cc928e-ddcf-4f73-a5aa-c74bb6de485a', '45c4d7df-ee3d-4d70-8fb1-d5d596f7c49a', '52bff705-d68a-4d84-9146-6dff1a497570'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:26 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:26 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:26 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113" returned: 0 in 0.468s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-716c40a7-10d2-4b78-8095-02fb7effc7b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6bff9b-591f-469c-a2ef-532ea0ec8504]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:26 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1" returned: 0 in 0.313s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:26 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.info Sep 17 07:36:26 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:26 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 Sep 17 07:36:26 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:26 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.300s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:26 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Deleted volume successfully. Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-45c182c0-8db7-4d33-abaa-8f7d486dacad tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-26bb4653-e7c4-4448-bba0-f3fb27f34d12-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:26 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.info" returned: 0 in 0.313s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:26 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.info is being set with open permissions: ugo+rw Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:26 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.info Sep 17 07:36:26 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:26 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4" returned: 0 in 0.450s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:26 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 Sep 17 07:36:26 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:26 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.info" returned: 0 in 0.263s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.371s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:26 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-09590c55-2c89-41d0-9a11-4ecb369daed3 tempest-ProjectReaderTests-457785573 None] Create snapshot completed successfully Sep 17 07:36:27 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113" returned: 0 in 0.385s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:27 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113 Sep 17 07:36:27 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-2313aeee-ccdd-49ac-8be5-b9523da1409d-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-2313aeee-ccdd-49ac-8be5-b9523da1409d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-quobyte-2313aeee-ccdd-49ac-8be5-b9523da1409d" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-2313aeee-ccdd-49ac-8be5-b9523da1409d" acquired by "delete_volume" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[466386e0-a0ce-406e-9ce0-ba279b5a7a54]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2313aeee-ccdd-49ac-8be5-b9523da1409d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:27 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4.5a36858f-1102-4f53-ae93-a0e8d6ef2113" returned: 0 in 0.277s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Lock "cinder-quobyte-5a36858f-1102-4f53-ae93-a0e8d6ef2113" released by "_delete_snapshot" :: held 1.721s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:27 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2313aeee-ccdd-49ac-8be5-b9523da1409d Sep 17 07:36:27 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Lock "cinder-quobyte-716c40a7-10d2-4b78-8095-02fb7effc7b4" released by "delete_snapshot" :: held 1.746s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Created reservations ['d33560fb-c4d7-456f-b4fb-213cbb2df26f', '72d31070-0c5f-43d7-b9ab-9636149d91d1', 'e41a3145-c50e-4de6-b3a5-d4bf7f6041e8', '85f03a17-19fa-4deb-b599-45a0b5dce9b9'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:27 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Delete snapshot completed successfully. Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-69e55c19-4b15-422e-8b84-52ae5534013d tempest-CinderUnicodeTest-210503487 None] Lock "cinder-5a36858f-1102-4f53-ae93-a0e8d6ef2113-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:27 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2313aeee-ccdd-49ac-8be5-b9523da1409d" returned: 0 in 0.417s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2313aeee-ccdd-49ac-8be5-b9523da1409d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-2746b3e6-2a4b-447d-97e3-672974f0fab1-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Lock "cinder-2746b3e6-2a4b-447d-97e3-672974f0fab1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-7cf7f188-ce25-4aa3-af49-a4bddc3043dd" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:27 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2313aeee-ccdd-49ac-8be5-b9523da1409d Sep 17 07:36:27 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-7cf7f188-ce25-4aa3-af49-a4bddc3043dd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-2746b3e6-2a4b-447d-97e3-672974f0fab1" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-2746b3e6-2a4b-447d-97e3-672974f0fab1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Deleting offline snapshot 2746b3e6-2a4b-447d-97e3-672974f0fab1 of volume 7cf7f188-ce25-4aa3-af49-a4bddc3043dd {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] snapshot_file for this snap is: volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0303b1-e3c2-402e-9930-1db52087c678]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Acquiring lock "cinder-716c40a7-10d2-4b78-8095-02fb7effc7b4-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:27 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Lock "cinder-716c40a7-10d2-4b78-8095-02fb7effc7b4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:28 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Acquiring lock "cinder-quobyte-716c40a7-10d2-4b78-8095-02fb7effc7b4" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:28 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Lock "cinder-quobyte-716c40a7-10d2-4b78-8095-02fb7effc7b4" acquired by "delete_volume" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7829534a-0262-472a-bb20-70d6bfd1de08]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:28 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-2313aeee-ccdd-49ac-8be5-b9523da1409d" returned: 0 in 0.383s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-2313aeee-ccdd-49ac-8be5-b9523da1409d" released by "delete_volume" :: held 0.851s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Created reservations ['a8a50e15-4151-471f-8004-a2855cc64027', '61b97998-464a-4650-ad2f-69ebba189c8d', 'e105de9b-15c0-40ed-9cef-9ce2bfefe8e6', 'cde6b951-d7ec-4c58-99f9-e6c79c7a329b'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:28 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 Sep 17 07:36:28 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:28 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:28 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:28 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1" returned: 0 in 0.496s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-a10985bd-584d-492c-bad7-dbcf3a7430b8-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[55271b2e-c328-45b1-8462-c236c626f272]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-a10985bd-584d-492c-bad7-dbcf3a7430b8-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-quobyte-a10985bd-584d-492c-bad7-dbcf3a7430b8" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:28 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4" returned: 0 in 0.475s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:28 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd Sep 17 07:36:28 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-a10985bd-584d-492c-bad7-dbcf3a7430b8" acquired by "delete_volume" :: waited 0.052s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:28 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4 Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc19870-68a0-4f21-bde6-54b5d2cf00b9]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:28 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a10985bd-584d-492c-bad7-dbcf3a7430b8 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:28 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a10985bd-584d-492c-bad7-dbcf3a7430b8 Sep 17 07:36:28 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:28 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.535s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:28 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Deleted volume successfully. Sep 17 07:36:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-dbffaf32-9f31-4e82-be0e-eb93737615fb tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-2313aeee-ccdd-49ac-8be5-b9523da1409d-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:29 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd" returned: 0 in 0.580s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:29 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-716c40a7-10d2-4b78-8095-02fb7effc7b4" returned: 0 in 0.464s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:29 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 Sep 17 07:36:29 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Lock "cinder-quobyte-716c40a7-10d2-4b78-8095-02fb7effc7b4" released by "delete_volume" :: held 1.050s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:29 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a10985bd-584d-492c-bad7-dbcf3a7430b8" returned: 0 in 0.562s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a10985bd-584d-492c-bad7-dbcf3a7430b8 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Created reservations ['ea16745b-839c-499e-bc1f-4962f8795b1a', '85f17d87-a64d-4ce1-9960-51e4d6a3141b', '0262c289-3cf2-4b01-b8f6-023260c6d9ab', '6b430119-0d29-4419-9c16-3163b51f1036'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:29 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a10985bd-584d-492c-bad7-dbcf3a7430b8 Sep 17 07:36:29 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:29 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:29 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:29 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1" returned: 0 in 0.470s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:29 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1 Sep 17 07:36:29 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:29 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a10985bd-584d-492c-bad7-dbcf3a7430b8" returned: 0 in 0.371s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-a10985bd-584d-492c-bad7-dbcf3a7430b8" released by "delete_volume" :: held 0.994s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:29 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.334s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:29 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Deleted volume successfully. Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-408e103e-cf9b-4186-8bba-8b836336edcf tempest-CinderUnicodeTest-210503487 None] Lock "cinder-716c40a7-10d2-4b78-8095-02fb7effc7b4-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Created reservations ['5c8f2390-a231-4f1e-a4fb-80b2550fe65e', '39909c24-4200-43e7-baa2-4c4f02ec9c7d', '851c0556-e51d-4da1-824d-e14de7043efe', 'd332a3d6-22e9-4c8b-bae6-9ae83a97cd83'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:29 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:29 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:29 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd.2746b3e6-2a4b-447d-97e3-672974f0fab1" returned: 0 in 0.328s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-2746b3e6-2a4b-447d-97e3-672974f0fab1" released by "_delete_snapshot" :: held 2.013s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-7cf7f188-ce25-4aa3-af49-a4bddc3043dd" released by "delete_snapshot" :: held 2.044s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Created reservations ['d4e6fae1-8e02-4422-9514-0cbe6fb2b65e', '26efa683-a41f-4bda-9e38-dfbed1dfc8a8', '703cdfc9-3cfc-443c-ae90-4a1254204863', '39ebc270-3d10-436f-8072-7a04eede7682'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:29 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Delete snapshot completed successfully. Sep 17 07:36:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-a56f5328-f400-4bc6-9208-8185a5a42513 tempest-ProjectReaderTests-457785573 None] Lock "cinder-2746b3e6-2a4b-447d-97e3-672974f0fab1-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:30 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.274s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:30 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Deleted volume successfully. Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1813b58-41ae-4003-8556-a51219afab76 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-a10985bd-584d-492c-bad7-dbcf3a7430b8-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Acquiring lock "cinder-9b8bf833-5703-404e-8a79-f3310ce8b43a-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Lock "cinder-9b8bf833-5703-404e-8a79-f3310ce8b43a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Acquiring lock "cinder-quobyte-9b8bf833-5703-404e-8a79-f3310ce8b43a" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Lock "cinder-quobyte-9b8bf833-5703-404e-8a79-f3310ce8b43a" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[792bd290-8522-41a9-8c34-e4474d2e225f]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9b8bf833-5703-404e-8a79-f3310ce8b43a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:30 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9b8bf833-5703-404e-8a79-f3310ce8b43a Sep 17 07:36:30 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-95c90987-64ad-4ca3-b2e8-2571109aee62-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-95c90987-64ad-4ca3-b2e8-2571109aee62-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-quobyte-95c90987-64ad-4ca3-b2e8-2571109aee62" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-95c90987-64ad-4ca3-b2e8-2571109aee62" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b33efdf-5c9b-4791-9a7a-ea74018bdd05]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-95c90987-64ad-4ca3-b2e8-2571109aee62 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:30 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9b8bf833-5703-404e-8a79-f3310ce8b43a" returned: 0 in 0.421s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9b8bf833-5703-404e-8a79-f3310ce8b43a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:30 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9b8bf833-5703-404e-8a79-f3310ce8b43a Sep 17 07:36:30 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:30 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-95c90987-64ad-4ca3-b2e8-2571109aee62 Sep 17 07:36:30 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-7cf7f188-ce25-4aa3-af49-a4bddc3043dd-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Lock "cinder-7cf7f188-ce25-4aa3-af49-a4bddc3043dd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-7cf7f188-ce25-4aa3-af49-a4bddc3043dd" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-7cf7f188-ce25-4aa3-af49-a4bddc3043dd" acquired by "delete_volume" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:31 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9b8bf833-5703-404e-8a79-f3310ce8b43a" returned: 0 in 0.367s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Lock "cinder-quobyte-9b8bf833-5703-404e-8a79-f3310ce8b43a" released by "delete_volume" :: held 0.834s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[31206a92-69bd-4808-8e95-18a0d481f5b3]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Created reservations ['041effba-1d7b-427a-a030-8c386fa4985f', '702a9e03-4016-45b1-9859-801dcaed2072', '0982a731-0400-4c08-b39e-d3bd20a18d98', '31aa1702-3429-4823-8730-7f35f24c5901'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:31 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-95c90987-64ad-4ca3-b2e8-2571109aee62" returned: 0 in 0.508s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-95c90987-64ad-4ca3-b2e8-2571109aee62 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:31 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-95c90987-64ad-4ca3-b2e8-2571109aee62 Sep 17 07:36:31 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:31 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd Sep 17 07:36:31 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:31 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:31 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:31 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-95c90987-64ad-4ca3-b2e8-2571109aee62" returned: 0 in 0.314s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-95c90987-64ad-4ca3-b2e8-2571109aee62" released by "delete_volume" :: held 0.878s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:31 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd" returned: 0 in 0.513s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Created reservations ['782d92e8-5358-4d68-8838-a5fa8e653838', '5660c1bc-8e94-4aee-a4c4-5bd760da1818', '43f8117a-3aa2-4e54-897b-f51764ba5964', 'c980cbe8-d57d-4541-97cd-5fba00020873'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:31 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd Sep 17 07:36:31 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:31 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.446s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:31 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Deleted volume successfully. Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-0109b153-41f1-4c7d-b169-72c6681761ad tempest-CinderUnicodeTest-210503487 None] Lock "cinder-9b8bf833-5703-404e-8a79-f3310ce8b43a-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-c985f338-e49c-41e8-9ea8-7f826f9eaedc-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:31 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:31 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-c985f338-e49c-41e8-9ea8-7f826f9eaedc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-quobyte-079da111-bcaa-4e63-b301-9e756f14c164" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-079da111-bcaa-4e63-b301-9e756f14c164" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-quobyte-c985f338-e49c-41e8-9ea8-7f826f9eaedc" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-c985f338-e49c-41e8-9ea8-7f826f9eaedc" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Deleting offline snapshot c985f338-e49c-41e8-9ea8-7f826f9eaedc of volume 079da111-bcaa-4e63-b301-9e756f14c164 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] snapshot_file for this snap is: volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:36:32 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-7cf7f188-ce25-4aa3-af49-a4bddc3043dd" returned: 0 in 0.370s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cef3324-b58d-4760-8e9c-1eee911bedb4]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-7cf7f188-ce25-4aa3-af49-a4bddc3043dd" released by "delete_volume" :: held 0.988s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Created reservations ['6ce90d26-8b53-4f87-9b15-58dc0e1fc818', '40defd82-adf4-4cc1-a621-2122f5509a00', 'b04b004b-5060-45f7-8d73-a1ad26f19dd2', '5f547170-31e4-449d-b902-6a64b226ffe6'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:32 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.385s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:32 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Deleted volume successfully. Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2912a241-1df1-4c0d-b679-802bb7755b37 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-95c90987-64ad-4ca3-b2e8-2571109aee62-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:32 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc Sep 17 07:36:32 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:32 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:32 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:32 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc" returned: 0 in 0.605s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079da111-bcaa-4e63-b301-9e756f14c164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:36:32 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.368s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:32 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Deleted volume successfully. Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a71c34-2882-4089-98d6-8a5ceec77030]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:32 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-29757391-f904-43e0-bcd9-c2194dc9e463 tempest-ProjectReaderTests-457785573 None] Lock "cinder-7cf7f188-ce25-4aa3-af49-a4bddc3043dd-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:32 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164 Sep 17 07:36:32 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:33 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164" returned: 0 in 0.466s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:33 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc Sep 17 07:36:33 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:33 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc" returned: 0 in 0.406s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:33 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc Sep 17 07:36:33 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Flow 'volume_create_manager' (ea16728c-49be-4891-96fe-183d067b703e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a561369-6193-489f-88a6-d9271e319d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a561369-6193-489f-88a6-d9271e319d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-9153803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ecef97-f0f3-4ae9-b9cd-fffbd6069878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe5224828af419d9d43f2eaa0fa021e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:34Z,use_quota=True,user_id='06328113b44e4c4084658b9ffaba06c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea09a2b3-ba7f-449f-9283-c9f71a8e6ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea09a2b3-ba7f-449f-9283-c9f71a8e6ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1728db50-b2a9-4cec-b85f-ef9b77086d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1728db50-b2a9-4cec-b85f-ef9b77086d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47ecef97-f0f3-4ae9-b9cd-fffbd6069878', 'volume_name': 'volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc559697-5b88-49dd-86fb-cb1e962dfdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc559697-5b88-49dd-86fb-cb1e962dfdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06452fbb-5465-4106-8882-ce79acda0612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:33 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Volume 47ecef97-f0f3-4ae9-b9cd-fffbd6069878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878', 'volume_size': 1} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-9153803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ecef97-f0f3-4ae9-b9cd-fffbd6069878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe5224828af419d9d43f2eaa0fa021e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:34Z,use_quota=True,user_id='06328113b44e4c4084658b9ffaba06c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Creating volume 47ecef97-f0f3-4ae9-b9cd-fffbd6069878 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:33 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:33 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:33 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164.c985f338-e49c-41e8-9ea8-7f826f9eaedc" returned: 0 in 0.310s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:33 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 1073741824 Sep 17 07:36:33 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-c985f338-e49c-41e8-9ea8-7f826f9eaedc" released by "_delete_snapshot" :: held 1.988s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-079da111-bcaa-4e63-b301-9e756f14c164" released by "delete_snapshot" :: held 2.026s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:34 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Created reservations ['399c3f2f-9e40-499d-87f1-833321fffd4d', '5ff1db1d-7cb5-46bd-b88b-a04e77b69453', 'e9b3b0ca-28bd-4f4c-b1f5-0be3419f5574', '6767c781-91c7-4e8d-9d9a-4fd82e564f56'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:34 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Delete snapshot completed successfully. Sep 17 07:36:34 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-b1c2d32f-6294-46cd-9b87-5f59cb24baac tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-c985f338-e49c-41e8-9ea8-7f826f9eaedc-delete_snapshot" released by "delete_snapshot" :: held 2.226s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:34 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 1073741824" returned: 0 in 0.568s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:34 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 Sep 17 07:36:34 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:34 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878" returned: 0 in 0.289s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:34 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06452fbb-5465-4106-8882-ce79acda0612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d70c5d2-e232-4107-84ee-42d524d6b1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:34 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Volume volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 (47ecef97-f0f3-4ae9-b9cd-fffbd6069878): created successfully Sep 17 07:36:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d70c5d2-e232-4107-84ee-42d524d6b1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:34 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Flow 'volume_create_manager' (ea16728c-49be-4891-96fe-183d067b703e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:34 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4f800664-0afb-400f-8310-2f9ceef78e68 tempest-ProjectReaderTests-457785573 None] Created volume successfully. Sep 17 07:36:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-079da111-bcaa-4e63-b301-9e756f14c164-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-079da111-bcaa-4e63-b301-9e756f14c164-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "cinder-quobyte-079da111-bcaa-4e63-b301-9e756f14c164" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:35 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-079da111-bcaa-4e63-b301-9e756f14c164" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:35 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-af365160-467c-482c-88bb-22c4614e3bd6 tempest-ProjectAdminTests-695746772 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8438682556152, 'free_capacity_gb': 1775.8438682556152, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86029) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 07:36:35 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c682280f-7553-4b96-83e1-4bbd61f85caa]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:35 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164 Sep 17 07:36:35 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:35 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164" returned: 0 in 0.378s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:35 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164 Sep 17 07:36:35 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:35 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-079da111-bcaa-4e63-b301-9e756f14c164" returned: 0 in 0.263s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-quobyte-079da111-bcaa-4e63-b301-9e756f14c164" released by "delete_volume" :: held 0.719s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Created reservations ['7e2df87a-ffdf-4ecc-89fc-8826ff5ea604', '21f871db-f0ed-4832-94cf-3bbcbd2c4459', 'f30c356a-a844-457c-a7a3-06784b44d4f2', 'eaddd1fb-5dc9-4f62-90e1-c62e53a840a4'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] Creating offline snapshot f42a3f91-653d-472c-88e5-16294e7aeb95 of volume 47ecef97-f0f3-4ae9-b9cd-fffbd6069878 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8c5be5-0d10-4310-89eb-e92240d2bfbf]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:36 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:36 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:36 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 Sep 17 07:36:36 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:36 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.358s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:36 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Deleted volume successfully. Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-01712d3e-2144-4b18-a1e4-3af01f1f7b12 tempest-CreateVolumesFromSnapshotTest-849874723 None] Lock "cinder-079da111-bcaa-4e63-b301-9e756f14c164-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:36 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878" returned: 0 in 0.543s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:36 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 1G Sep 17 07:36:36 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:37 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 1G" returned: 0 in 0.578s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:37 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 Sep 17 07:36:37 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:37 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95" returned: 0 in 0.411s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:37 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 is being set with open permissions: ugo+rw Sep 17 07:36:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:37 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 Sep 17 07:36:37 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:37 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95" returned: 0 in 0.316s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:38 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=230,cinder:UPDATE=295,cinder:DELETE=29,cinder:INSERT=80 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:36:38 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:UPDATE=340,cinder:SELECT=236,cinder:INSERT=90,cinder:DELETE=27 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:36:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:38 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.info Sep 17 07:36:38 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:38 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.info" returned: 0 in 0.328s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:38 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.info is being set with open permissions: ugo+rw Sep 17 07:36:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:38 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.info Sep 17 07:36:38 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:38 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.info" returned: 0 in 0.339s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.668s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:38 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e18d12a6-02de-4628-ab7d-719923633026 tempest-ProjectReaderTests-457785573 None] Create snapshot completed successfully Sep 17 07:36:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-f42a3f91-653d-472c-88e5-16294e7aeb95-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Lock "cinder-f42a3f91-653d-472c-88e5-16294e7aeb95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-47ecef97-f0f3-4ae9-b9cd-fffbd6069878" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-47ecef97-f0f3-4ae9-b9cd-fffbd6069878" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-f42a3f91-653d-472c-88e5-16294e7aeb95" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-f42a3f91-653d-472c-88e5-16294e7aeb95" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:39 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Deleting offline snapshot f42a3f91-653d-472c-88e5-16294e7aeb95 of volume 47ecef97-f0f3-4ae9-b9cd-fffbd6069878 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:36:39 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] snapshot_file for this snap is: volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:36:39 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e45af79-edf2-4afe-bfc9-f12a7dd4fdfb]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:39 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 Sep 17 07:36:39 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:39 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95" returned: 0 in 0.399s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:39 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:36:39 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ba7c45-5a21-4c6f-8cf6-7de2224b1504]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:39 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 Sep 17 07:36:39 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:40 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878" returned: 0 in 0.431s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:40 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 Sep 17 07:36:40 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:40 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95" returned: 0 in 0.504s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:40 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95 Sep 17 07:36:40 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:41 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878.f42a3f91-653d-472c-88e5-16294e7aeb95" returned: 0 in 0.298s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-f42a3f91-653d-472c-88e5-16294e7aeb95" released by "_delete_snapshot" :: held 1.763s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-47ecef97-f0f3-4ae9-b9cd-fffbd6069878" released by "delete_snapshot" :: held 1.793s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:41 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Created reservations ['3b3b2254-4e12-46af-afc7-9eeb4bc82156', '3dd7d8bd-3273-454c-ad71-ac3fa1553d6a', '60939c3f-5ca6-471a-a212-6fe5c2acf8dc', '05dc09d7-2968-40cc-997e-caa2baf4310e'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:41 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Delete snapshot completed successfully. Sep 17 07:36:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d6e39879-5630-48c5-8f07-ac32416d54ce tempest-ProjectReaderTests-457785573 None] Lock "cinder-f42a3f91-653d-472c-88e5-16294e7aeb95-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-47ecef97-f0f3-4ae9-b9cd-fffbd6069878-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Lock "cinder-47ecef97-f0f3-4ae9-b9cd-fffbd6069878-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-47ecef97-f0f3-4ae9-b9cd-fffbd6069878" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:41 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-47ecef97-f0f3-4ae9-b9cd-fffbd6069878" acquired by "delete_volume" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:41 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a0111d-fdda-4ac7-a923-b41b738501cb]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:41 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 Sep 17 07:36:41 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:42 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878" returned: 0 in 0.441s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:42 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878 Sep 17 07:36:42 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:42 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-47ecef97-f0f3-4ae9-b9cd-fffbd6069878" returned: 0 in 0.352s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:42 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-47ecef97-f0f3-4ae9-b9cd-fffbd6069878" released by "delete_volume" :: held 0.883s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:42 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Created reservations ['cbf01334-a953-4b49-9e4e-e86b6ec5407d', '56fd4f98-65d8-434f-bbc6-b88b20b05874', 'bdb66b98-437a-4889-90af-46bad89bdf35', 'ceb8c0f2-0aca-4448-aac7-8ac75a3d65f3'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:42 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:42 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:43 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.443s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:43 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Deleted volume successfully. Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1eabaad4-bfe8-4fda-90d5-ceedfc8ff2b7 tempest-ProjectReaderTests-457785573 None] Lock "cinder-47ecef97-f0f3-4ae9-b9cd-fffbd6069878-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Flow 'volume_create_manager' (03ef301a-50a9-417b-b5c3-98e907c245ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe03384-02b3-4e57-b6a3-27d8d7059c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe03384-02b3-4e57-b6a3-27d8d7059c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-630938804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe5224828af419d9d43f2eaa0fa021e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:44Z,use_quota=True,user_id='06328113b44e4c4084658b9ffaba06c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4cec8c-dc00-484f-80b0-b521d643c9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4cec8c-dc00-484f-80b0-b521d643c9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad526787-be62-4a09-92c7-3bf2f92b23f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad526787-be62-4a09-92c7-3bf2f92b23f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54', 'volume_name': 'volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83eb645d-e6cb-42fc-86a9-c72cebec1f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83eb645d-e6cb-42fc-86a9-c72cebec1f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fffb5a62-cb46-4c2d-b83f-14035098b33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:43 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Volume e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54', 'volume_size': 1} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-630938804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe5224828af419d9d43f2eaa0fa021e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:44Z,use_quota=True,user_id='06328113b44e4c4084658b9ffaba06c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Creating volume e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:43 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:43 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 1073741824 Sep 17 07:36:43 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:44 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 1073741824" returned: 0 in 0.491s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:44 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 Sep 17 07:36:44 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:44 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54" returned: 0 in 0.355s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fffb5a62-cb46-4c2d-b83f-14035098b33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5bca5b1-1667-4bb1-8e27-3e24d20b1e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:44 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Volume volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 (e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54): created successfully Sep 17 07:36:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5bca5b1-1667-4bb1-8e27-3e24d20b1e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:44 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Flow 'volume_create_manager' (03ef301a-50a9-417b-b5c3-98e907c245ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:44 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-5f803086-23e9-4db1-ac10-c6ef193064fc tempest-ProjectReaderTests-457785573 None] Created volume successfully. Sep 17 07:36:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] Creating offline snapshot 54871a9e-07b1-4d35-a8fd-7f8c4dda103e of volume e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:36:45 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[98be20d3-6ec4-4f99-9fbc-851c9a1e152c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:46 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 Sep 17 07:36:46 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:46 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54" returned: 0 in 0.405s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:46 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e 1G Sep 17 07:36:46 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:46 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e 1G" returned: 0 in 0.526s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:46 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e Sep 17 07:36:46 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (48d3904f-16da-4b9f-8a13-bce026902514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66e152d-a2c0-4b01-938f-506e4689b90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:47 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e" returned: 0 in 0.391s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:47 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e is being set with open permissions: ugo+rw Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66e152d-a2c0-4b01-938f-506e4689b90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303195163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a8c696-f0b2-4434-b99b-463036e72844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:47Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3c10bd-c093-44f1-a9ab-207afd577017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:47 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3c10bd-c093-44f1-a9ab-207afd577017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:47 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d46b313-1743-45bc-b7df-62418bbdb05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d46b313-1743-45bc-b7df-62418bbdb05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87a8c696-f0b2-4434-b99b-463036e72844', 'volume_name': 'volume-87a8c696-f0b2-4434-b99b-463036e72844', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3900e7-5184-405e-b5cf-3eb7948d0185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3900e7-5184-405e-b5cf-3eb7948d0185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c000d9be-ff69-4e9b-9770-ff6c817f374a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:47 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Volume 87a8c696-f0b2-4434-b99b-463036e72844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87a8c696-f0b2-4434-b99b-463036e72844', 'volume_size': 1} Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:47 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e" returned: 0 in 0.273s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:47 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.info Sep 17 07:36:47 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:47 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.info" returned: 0 in 0.279s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:47 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.info is being set with open permissions: ugo+rw Sep 17 07:36:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:47 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.info Sep 17 07:36:47 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:48 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.info" returned: 0 in 0.273s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.834s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303195163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a8c696-f0b2-4434-b99b-463036e72844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:47Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Creating volume 87a8c696-f0b2-4434-b99b-463036e72844 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:48 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:48 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b36f7143-30d1-4b60-9504-5719861c8c2a tempest-ProjectReaderTests-457785573 None] Create snapshot completed successfully Sep 17 07:36:48 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844 1073741824 Sep 17 07:36:48 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Flow 'volume_create_manager' (fb8cd4f0-0977-4c50-9385-9d2aaf0a966b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00f6d9a-6605-4eed-8387-9e53c75a8ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00f6d9a-6605-4eed-8387-9e53c75a8ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1354524821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330ee83c-97fb-4077-858c-e5c8972bab27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e36d69b205b04bdba7902d55b4293c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:48Z,use_quota=True,user_id='8485f156a5494d8bab5c8aa5a30ddc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c52d149-01ec-4f37-9f2d-9eb372e466d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c52d149-01ec-4f37-9f2d-9eb372e466d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73454da-fd54-409a-85ba-b6f933607e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73454da-fd54-409a-85ba-b6f933607e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '330ee83c-97fb-4077-858c-e5c8972bab27', 'volume_name': 'volume-330ee83c-97fb-4077-858c-e5c8972bab27', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e4fdf0-c354-4b78-b3b0-85c3275ce4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e4fdf0-c354-4b78-b3b0-85c3275ce4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c851646-ae19-43b8-84b4-e74886e64315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:48 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Volume 330ee83c-97fb-4077-858c-e5c8972bab27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-330ee83c-97fb-4077-858c-e5c8972bab27', 'volume_size': 1} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:48 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844 1073741824" returned: 0 in 0.537s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:48 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844 Sep 17 07:36:48 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:49 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844" returned: 0 in 0.258s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1354524821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330ee83c-97fb-4077-858c-e5c8972bab27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e36d69b205b04bdba7902d55b4293c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:48Z,use_quota=True,user_id='8485f156a5494d8bab5c8aa5a30ddc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Creating volume 330ee83c-97fb-4077-858c-e5c8972bab27 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:49 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-330ee83c-97fb-4077-858c-e5c8972bab27 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c000d9be-ff69-4e9b-9770-ff6c817f374a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a8c696-f0b2-4434-b99b-463036e72844', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (838d7d98-dbf3-45b3-b55c-a7fa194c7038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:49 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-330ee83c-97fb-4077-858c-e5c8972bab27 1073741824 Sep 17 07:36:49 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:49 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Volume volume-87a8c696-f0b2-4434-b99b-463036e72844 (87a8c696-f0b2-4434-b99b-463036e72844): created successfully Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (838d7d98-dbf3-45b3-b55c-a7fa194c7038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (48d3904f-16da-4b9f-8a13-bce026902514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:49 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d65d7030-29ec-4967-8c0d-beef44a27541 tempest-ProjectMemberTests-78710590 None] Created volume successfully. Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-54871a9e-07b1-4d35-a8fd-7f8c4dda103e-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Lock "cinder-54871a9e-07b1-4d35-a8fd-7f8c4dda103e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-54871a9e-07b1-4d35-a8fd-7f8c4dda103e" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-54871a9e-07b1-4d35-a8fd-7f8c4dda103e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Deleting offline snapshot 54871a9e-07b1-4d35-a8fd-7f8c4dda103e of volume e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] snapshot_file for this snap is: volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[da678960-1613-40ee-a222-296c059dd0b8]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:49 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e Sep 17 07:36:49 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:49 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-330ee83c-97fb-4077-858c-e5c8972bab27 1073741824" returned: 0 in 0.531s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-330ee83c-97fb-4077-858c-e5c8972bab27 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:49 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-330ee83c-97fb-4077-858c-e5c8972bab27 Sep 17 07:36:49 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:49 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e" returned: 0 in 0.435s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb99446-5563-461f-8353-463252617bb9]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:49 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-330ee83c-97fb-4077-858c-e5c8972bab27" returned: 0 in 0.288s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c851646-ae19-43b8-84b4-e74886e64315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330ee83c-97fb-4077-858c-e5c8972bab27', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605f914e-8d4a-47e4-8d44-8ef2d193151c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:49 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Volume volume-330ee83c-97fb-4077-858c-e5c8972bab27 (330ee83c-97fb-4077-858c-e5c8972bab27): created successfully Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605f914e-8d4a-47e4-8d44-8ef2d193151c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Flow 'volume_create_manager' (fb8cd4f0-0977-4c50-9385-9d2aaf0a966b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] Creating offline snapshot 28272f7f-e2ea-4c92-ae07-f4f2f071bb9d of volume 87a8c696-f0b2-4434-b99b-463036e72844 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:36:49 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 Sep 17 07:36:49 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:49 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-c78c8056-c8ea-4ab7-ab0a-d0c5606276d3 tempest-ProjectReaderTests-1518546251 None] Created volume successfully. Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3fe723-4719-4b7a-bea9-29479ce53f5b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:50 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844 Sep 17 07:36:50 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:50 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54" returned: 0 in 0.371s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:50 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e Sep 17 07:36:50 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:50 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844" returned: 0 in 0.383s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:50 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d 1G Sep 17 07:36:50 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:50 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e" returned: 0 in 0.376s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:50 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e Sep 17 07:36:50 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "cinder-330ee83c-97fb-4077-858c-e5c8972bab27-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Lock "cinder-330ee83c-97fb-4077-858c-e5c8972bab27-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "cinder-quobyte-330ee83c-97fb-4077-858c-e5c8972bab27" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Lock "cinder-quobyte-330ee83c-97fb-4077-858c-e5c8972bab27" acquired by "delete_volume" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2cfb14-790f-4bd4-9674-990a257c4f92]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-330ee83c-97fb-4077-858c-e5c8972bab27 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:50 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d 1G" returned: 0 in 0.514s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87a8c696-f0b2-4434-b99b-463036e72844 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:50 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54.54871a9e-07b1-4d35-a8fd-7f8c4dda103e" returned: 0 in 0.312s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:50 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87a8c696-f0b2-4434-b99b-463036e72844 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d Sep 17 07:36:50 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-54871a9e-07b1-4d35-a8fd-7f8c4dda103e" released by "_delete_snapshot" :: held 1.639s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:50 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-330ee83c-97fb-4077-858c-e5c8972bab27 Sep 17 07:36:50 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:50 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54" released by "delete_snapshot" :: held 1.667s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Created reservations ['9727fabb-ae00-40c9-872b-68cefd1c11dc', '537bed38-5dc0-49a4-97f8-16785b609f01', '897b8c7e-acdd-41d9-9c06-dd67df8a6a2b', 'e146f6ce-b6c5-43d5-8fbe-3413643fae8e'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:51 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Delete snapshot completed successfully. Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4b881a42-b932-47b1-8640-fb9867b9b04d tempest-ProjectReaderTests-457785573 None] Lock "cinder-54871a9e-07b1-4d35-a8fd-7f8c4dda103e-delete_snapshot" released by "delete_snapshot" :: held 1.817s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:51 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:51 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87a8c696-f0b2-4434-b99b-463036e72844 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d" returned: 0 in 0.325s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:51 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d is being set with open permissions: ugo+rw Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-330ee83c-97fb-4077-858c-e5c8972bab27" returned: 0 in 0.405s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-330ee83c-97fb-4077-858c-e5c8972bab27 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:51 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d Sep 17 07:36:51 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:51 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-330ee83c-97fb-4077-858c-e5c8972bab27 Sep 17 07:36:51 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Lock "cinder-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:51 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d" returned: 0 in 0.261s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:51 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-330ee83c-97fb-4077-858c-e5c8972bab27" returned: 0 in 0.304s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a27ad29-4c6a-4516-80ea-5729b46ee89d]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Lock "cinder-quobyte-330ee83c-97fb-4077-858c-e5c8972bab27" released by "delete_volume" :: held 0.767s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:51 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.info Sep 17 07:36:51 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Created reservations ['ca9b7144-624c-4825-b559-d57444aaffb9', 'f73112ac-c35d-43b9-bff4-e877147986ba', 'fa94cb5b-c534-4b1a-81ca-328bb36e3d10', 'f066030c-9d8f-4f75-8dec-6ed3ac3fee2e'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:51 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 Sep 17 07:36:51 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:51 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:51 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:51 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.info" returned: 0 in 0.308s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:51 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.info is being set with open permissions: ugo+rw Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:51 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.info Sep 17 07:36:51 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:51 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54" returned: 0 in 0.386s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:51 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:51 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54 Sep 17 07:36:51 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:52 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.305s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:52 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Deleted volume successfully. Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-5c59edca-c5fb-4475-aad1-65ac39ba1ee7 tempest-ProjectReaderTests-1518546251 None] Lock "cinder-330ee83c-97fb-4077-858c-e5c8972bab27-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:52 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.info" returned: 0 in 0.304s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:52 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54" returned: 0 in 0.319s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54" released by "delete_volume" :: held 0.777s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:52 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-eda76a46-5048-4894-891f-873066d6c79a tempest-ProjectMemberTests-78710590 None] Create snapshot completed successfully Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Created reservations ['bd84319a-2b01-4446-8245-cd7f7eee2e14', '783d3de0-bec4-4a5c-92d0-7adbb6e69658', 'a86040f8-ff92-4bff-bc7a-7ef83ca7d099', '63812e27-7780-48ed-bd3b-77d87a81ee3a'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:52 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:52 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Flow 'volume_create_manager' (c0fde93e-def3-4bcf-a567-a7e12b6522cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6e5d24-fb38-49e6-abad-20de35a6aae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6e5d24-fb38-49e6-abad-20de35a6aae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65665117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064f599f-25f1-4b1f-9a58-3af39b18aedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e36d69b205b04bdba7902d55b4293c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:52Z,use_quota=True,user_id='8485f156a5494d8bab5c8aa5a30ddc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a33845-b6ae-48bf-8112-8c218b9611e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a33845-b6ae-48bf-8112-8c218b9611e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23c9784-4834-4c1d-9415-7bd3818bd775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23c9784-4834-4c1d-9415-7bd3818bd775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '064f599f-25f1-4b1f-9a58-3af39b18aedf', 'volume_name': 'volume-064f599f-25f1-4b1f-9a58-3af39b18aedf', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8ddc17-fc58-4512-ac96-024dc2d5752a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8ddc17-fc58-4512-ac96-024dc2d5752a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08e5c9e-1861-4ef4-81fd-400cc292ebf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:52 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Volume 064f599f-25f1-4b1f-9a58-3af39b18aedf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-064f599f-25f1-4b1f-9a58-3af39b18aedf', 'volume_size': 1} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65665117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064f599f-25f1-4b1f-9a58-3af39b18aedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e36d69b205b04bdba7902d55b4293c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:52Z,use_quota=True,user_id='8485f156a5494d8bab5c8aa5a30ddc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Creating volume 064f599f-25f1-4b1f-9a58-3af39b18aedf {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:52 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-064f599f-25f1-4b1f-9a58-3af39b18aedf 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:52 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-064f599f-25f1-4b1f-9a58-3af39b18aedf 1073741824 Sep 17 07:36:52 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:52 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.249s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:52 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Deleted volume successfully. Sep 17 07:36:52 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-7ef91c86-56f3-4cc1-82f4-a6ecaf7f3449 tempest-ProjectReaderTests-457785573 None] Lock "cinder-e8a55c92-e34f-42ea-8cf1-a3e1d8d71f54-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:53 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-064f599f-25f1-4b1f-9a58-3af39b18aedf 1073741824" returned: 0 in 0.502s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-064f599f-25f1-4b1f-9a58-3af39b18aedf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-28272f7f-e2ea-4c92-ae07-f4f2f071bb9d-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:53 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-064f599f-25f1-4b1f-9a58-3af39b18aedf Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Lock "cinder-28272f7f-e2ea-4c92-ae07-f4f2f071bb9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-87a8c696-f0b2-4434-b99b-463036e72844" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:53 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-87a8c696-f0b2-4434-b99b-463036e72844" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-28272f7f-e2ea-4c92-ae07-f4f2f071bb9d" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-28272f7f-e2ea-4c92-ae07-f4f2f071bb9d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Deleting offline snapshot 28272f7f-e2ea-4c92-ae07-f4f2f071bb9d of volume 87a8c696-f0b2-4434-b99b-463036e72844 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] snapshot_file for this snap is: volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f968055-cf0f-48ca-900a-fdc7d5407026]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Flow 'volume_create_manager' (ad0b8abf-c9ca-484a-8f43-f9cbd043ef9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d472374-f58e-40ad-9792-a89306312bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d472374-f58e-40ad-9792-a89306312bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1338517228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bede80-9a8d-4d84-9d77-a19e024ead8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe5224828af419d9d43f2eaa0fa021e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:53Z,use_quota=True,user_id='06328113b44e4c4084658b9ffaba06c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9d5e55-08cc-455b-9ffa-e94f1d64ce67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9d5e55-08cc-455b-9ffa-e94f1d64ce67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e158ce2-b2df-45ba-a9a8-e7ce493dc096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e158ce2-b2df-45ba-a9a8-e7ce493dc096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25bede80-9a8d-4d84-9d77-a19e024ead8b', 'volume_name': 'volume-25bede80-9a8d-4d84-9d77-a19e024ead8b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b0a7a6-ae1a-410f-b4e1-6ae54dcb7d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:53 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b0a7a6-ae1a-410f-b4e1-6ae54dcb7d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:53 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dead7d3c-e9da-4de9-8208-831dd279e71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:53 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Volume 25bede80-9a8d-4d84-9d77-a19e024ead8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25bede80-9a8d-4d84-9d77-a19e024ead8b', 'volume_size': 1} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:53 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-064f599f-25f1-4b1f-9a58-3af39b18aedf" returned: 0 in 0.310s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.071s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1338517228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bede80-9a8d-4d84-9d77-a19e024ead8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe5224828af419d9d43f2eaa0fa021e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:53Z,use_quota=True,user_id='06328113b44e4c4084658b9ffaba06c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Creating volume 25bede80-9a8d-4d84-9d77-a19e024ead8b {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:53 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08e5c9e-1861-4ef4-81fd-400cc292ebf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064f599f-25f1-4b1f-9a58-3af39b18aedf', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:53 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b 1073741824 Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a41ecea-1329-44bc-bc63-30bad2e9eac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:53 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:53 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Volume volume-064f599f-25f1-4b1f-9a58-3af39b18aedf (064f599f-25f1-4b1f-9a58-3af39b18aedf): created successfully Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a41ecea-1329-44bc-bc63-30bad2e9eac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Flow 'volume_create_manager' (c0fde93e-def3-4bcf-a567-a7e12b6522cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:53 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-c05d8a88-bbfb-45fd-a774-bd317826ed4c tempest-ProjectReaderTests-1518546251 None] Created volume successfully. Sep 17 07:36:53 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d" returned: 0 in 0.376s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87a8c696-f0b2-4434-b99b-463036e72844(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f1a918-728d-45b9-a8c5-996891794139]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:53 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844 Sep 17 07:36:53 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:53 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b 1073741824" returned: 0 in 0.450s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:53 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b Sep 17 07:36:53 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:53 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844" returned: 0 in 0.388s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:53 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:54 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d Sep 17 07:36:54 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:54 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b" returned: 0 in 0.267s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dead7d3c-e9da-4de9-8208-831dd279e71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25bede80-9a8d-4d84-9d77-a19e024ead8b', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7717b1-6567-4c9e-a6da-f3c846f0e3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:54 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Volume volume-25bede80-9a8d-4d84-9d77-a19e024ead8b (25bede80-9a8d-4d84-9d77-a19e024ead8b): created successfully Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7717b1-6567-4c9e-a6da-f3c846f0e3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Flow 'volume_create_manager' (ad0b8abf-c9ca-484a-8f43-f9cbd043ef9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:54 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-17254254-fc1f-4508-bf0f-b5ec2e6618e6 tempest-ProjectReaderTests-457785573 None] Created volume successfully. Sep 17 07:36:54 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d" returned: 0 in 0.334s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:54 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d Sep 17 07:36:54 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Acquiring lock "cinder-064f599f-25f1-4b1f-9a58-3af39b18aedf-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Lock "cinder-064f599f-25f1-4b1f-9a58-3af39b18aedf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:54 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Acquiring lock "cinder-quobyte-064f599f-25f1-4b1f-9a58-3af39b18aedf" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844.28272f7f-e2ea-4c92-ae07-f4f2f071bb9d" returned: 0 in 0.276s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Lock "cinder-quobyte-064f599f-25f1-4b1f-9a58-3af39b18aedf" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[de089351-92c0-4159-8e08-d7f3ca83015b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-064f599f-25f1-4b1f-9a58-3af39b18aedf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-28272f7f-e2ea-4c92-ae07-f4f2f071bb9d" released by "_delete_snapshot" :: held 1.536s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-87a8c696-f0b2-4434-b99b-463036e72844" released by "delete_snapshot" :: held 1.567s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Created reservations ['0612aaae-76c1-43e6-83a7-946ea3884467', '15c2eafe-1d32-481e-a0f8-f119b48a4af9', 'ccbd691b-f023-41ab-8d76-fe3e24453bd2', '7cc1cd66-cb02-48fd-a7ea-b90ebce12bc4'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:54 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-064f599f-25f1-4b1f-9a58-3af39b18aedf Sep 17 07:36:54 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:54 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Delete snapshot completed successfully. Sep 17 07:36:54 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-334c969c-2e3b-4f85-b64f-dfb693ac27c7 tempest-ProjectMemberTests-78710590 None] Lock "cinder-28272f7f-e2ea-4c92-ae07-f4f2f071bb9d-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:55 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-064f599f-25f1-4b1f-9a58-3af39b18aedf" returned: 0 in 0.402s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-064f599f-25f1-4b1f-9a58-3af39b18aedf {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:55 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-064f599f-25f1-4b1f-9a58-3af39b18aedf Sep 17 07:36:55 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-87a8c696-f0b2-4434-b99b-463036e72844-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Lock "cinder-87a8c696-f0b2-4434-b99b-463036e72844-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:55 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-064f599f-25f1-4b1f-9a58-3af39b18aedf" returned: 0 in 0.297s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Lock "cinder-quobyte-064f599f-25f1-4b1f-9a58-3af39b18aedf" released by "delete_volume" :: held 0.769s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-87a8c696-f0b2-4434-b99b-463036e72844" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-87a8c696-f0b2-4434-b99b-463036e72844" acquired by "delete_volume" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b04144-56e3-4b53-a06d-a8121cf881bf]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] Creating offline snapshot 904dd461-93ab-476f-9f60-4df8e1fa287b of volume 25bede80-9a8d-4d84-9d77-a19e024ead8b {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66bc977-e52e-490b-b1fd-4d7beea4e4ec]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Created reservations ['a78ce516-d40f-44be-9433-8afe49173505', 'f68e1c89-9cb8-45f2-83d2-6e94cdb0c853', 'd1769f47-4962-486d-b869-25e71f0ea8bb', 'b09a85c7-83bf-4896-b5c1-839292da2837'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:55 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844 Sep 17 07:36:55 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:55 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b Sep 17 07:36:55 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:55 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:55 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:55 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844" returned: 0 in 0.404s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:55 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.282s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:55 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844 Sep 17 07:36:55 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:55 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Deleted volume successfully. Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d3b69a28-fa36-44ca-8e5f-5f076f7ee3aa tempest-ProjectReaderTests-1518546251 None] Lock "cinder-064f599f-25f1-4b1f-9a58-3af39b18aedf-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:55 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b" returned: 0 in 0.457s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:55 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:55 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b 1G Sep 17 07:36:55 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:56 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-87a8c696-f0b2-4434-b99b-463036e72844" returned: 0 in 0.304s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-87a8c696-f0b2-4434-b99b-463036e72844" released by "delete_volume" :: held 0.784s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Flow 'volume_create_manager' (360d3a08-fd5f-4057-be16-9bdc8b0b64f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f089a79b-f718-4d75-887b-5dae4f01d353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f089a79b-f718-4d75-887b-5dae4f01d353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-488709025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e36d69b205b04bdba7902d55b4293c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:56Z,use_quota=True,user_id='8485f156a5494d8bab5c8aa5a30ddc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad2e2d2-126f-4af5-aa6f-30a56173dac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad2e2d2-126f-4af5-aa6f-30a56173dac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d6336f-47f0-4e68-bb2c-ac4661747f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d6336f-47f0-4e68-bb2c-ac4661747f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6', 'volume_name': 'volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f340c56-1251-4b03-90f8-d00a6f3bc1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f340c56-1251-4b03-90f8-d00a6f3bc1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0efca88-8423-4e90-8da1-d1c5a0c29af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:56 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Volume e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6', 'volume_size': 1} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Created reservations ['c4ae470c-5940-47b7-94f8-235b942c7777', 'a7c9ea6e-a590-4229-901e-b6629a7f2162', 'b6526246-1bce-4d01-939b-a3852fda3893', '9e21bdd7-7f26-47dc-b33b-65af2d5f3c82'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:56 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b 1G" returned: 0 in 0.449s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25bede80-9a8d-4d84-9d77-a19e024ead8b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:56 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25bede80-9a8d-4d84-9d77-a19e024ead8b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b Sep 17 07:36:56 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:56 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:36:56 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:56 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25bede80-9a8d-4d84-9d77-a19e024ead8b -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b" returned: 0 in 0.308s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:56 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b is being set with open permissions: ugo+rw Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:56 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:56 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b Sep 17 07:36:56 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.299s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:36:56 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Deleted volume successfully. Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-89d70c01-1654-414c-9c5c-96ec39463c6d tempest-ProjectMemberTests-78710590 None] Lock "cinder-87a8c696-f0b2-4434-b99b-463036e72844-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (f3d9ac57-df92-44f9-9c9b-dfb13289243a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d15228-0e65-436e-a0dd-fa09860c6e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:56 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b" returned: 0 in 0.278s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d15228-0e65-436e-a0dd-fa09860c6e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233963002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ff4fe0-acea-4509-a9c5-47d51c763e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:57Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e992a226-e345-44c8-a7e9-e083eea43a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e992a226-e345-44c8-a7e9-e083eea43a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66e66ef-7ca6-4cb0-b767-fe8db7ae4bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66e66ef-7ca6-4cb0-b767-fe8db7ae4bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5ff4fe0-acea-4509-a9c5-47d51c763e3c', 'volume_name': 'volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0b19f4-5405-400a-a152-c1c15322cc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0b19f4-5405-400a-a152-c1c15322cc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff025f4d-cd11-4efc-8ec1-e95d258007b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:57 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Volume e5ff4fe0-acea-4509-a9c5-47d51c763e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c', 'volume_size': 1} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:57 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.info Sep 17 07:36:57 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:57 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.info" returned: 0 in 0.250s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:57 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.info is being set with open permissions: ugo+rw Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:57 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.info Sep 17 07:36:57 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:57 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.info" returned: 0 in 0.243s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.233s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-488709025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e36d69b205b04bdba7902d55b4293c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:56Z,use_quota=True,user_id='8485f156a5494d8bab5c8aa5a30ddc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Creating volume e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:57 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:57 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6 1073741824 Sep 17 07:36:57 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:57 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-bba00378-2e85-4ceb-875d-835e0403391c tempest-ProjectReaderTests-457785573 None] Create snapshot completed successfully Sep 17 07:36:58 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6 1073741824" returned: 0 in 0.423s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:58 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6 Sep 17 07:36:58 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:58 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6" returned: 0 in 0.247s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.251s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233963002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ff4fe0-acea-4509-a9c5-47d51c763e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:36:57Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Creating volume e5ff4fe0-acea-4509-a9c5-47d51c763e3c {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:36:58 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0efca88-8423-4e90-8da1-d1c5a0c29af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:58 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c 1073741824 Sep 17 07:36:58 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd9bd94-3222-4d2c-8ebd-3574b72901c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:58 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Volume volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6 (e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6): created successfully Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd9bd94-3222-4d2c-8ebd-3574b72901c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Flow 'volume_create_manager' (360d3a08-fd5f-4057-be16-9bdc8b0b64f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3d8b4d3f-f5c2-4ba9-868c-d3da75251108 tempest-ProjectReaderTests-1518546251 None] Created volume successfully. Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-904dd461-93ab-476f-9f60-4df8e1fa287b-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Lock "cinder-904dd461-93ab-476f-9f60-4df8e1fa287b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-25bede80-9a8d-4d84-9d77-a19e024ead8b" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-25bede80-9a8d-4d84-9d77-a19e024ead8b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-904dd461-93ab-476f-9f60-4df8e1fa287b" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-904dd461-93ab-476f-9f60-4df8e1fa287b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Deleting offline snapshot 904dd461-93ab-476f-9f60-4df8e1fa287b of volume 25bede80-9a8d-4d84-9d77-a19e024ead8b {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] snapshot_file for this snap is: volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcf9557-05f7-4e1a-a788-259861e357ef]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:58 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c 1073741824" returned: 0 in 0.480s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:58 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b Sep 17 07:36:58 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:58 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c Sep 17 07:36:58 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:59 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b" returned: 0 in 0.380s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25bede80-9a8d-4d84-9d77-a19e024ead8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1041edf-849c-44f9-8924-20d95303a2e6]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:59 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c" returned: 0 in 0.262s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff025f4d-cd11-4efc-8ec1-e95d258007b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4b979e-08d2-4c29-8680-b82dd12e61d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:36:59 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Volume volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c (e5ff4fe0-acea-4509-a9c5-47d51c763e3c): created successfully Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4b979e-08d2-4c29-8680-b82dd12e61d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (f3d9ac57-df92-44f9-9c9b-dfb13289243a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:36:59 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-09406c66-6ecf-4f58-9d08-cd54bfce406a tempest-ProjectMemberTests-78710590 None] Created volume successfully. Sep 17 07:36:59 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b Sep 17 07:36:59 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "cinder-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Lock "cinder-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "cinder-quobyte-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:36:59 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b" returned: 0 in 0.379s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Lock "cinder-quobyte-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6" acquired by "delete_volume" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:36:59 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b Sep 17 07:36:59 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ea485f-8d8f-4450-9b75-1ed4b0909d0f]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:59 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6 Sep 17 07:36:59 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:59 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b" returned: 0 in 0.338s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:59 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b Sep 17 07:36:59 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:36:59 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6" returned: 0 in 0.380s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:36:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:36:59 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6 Sep 17 07:36:59 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:00 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b.904dd461-93ab-476f-9f60-4df8e1fa287b" returned: 0 in 0.264s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-904dd461-93ab-476f-9f60-4df8e1fa287b" released by "_delete_snapshot" :: held 1.465s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-25bede80-9a8d-4d84-9d77-a19e024ead8b" released by "delete_snapshot" :: held 1.499s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:00 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6" returned: 0 in 0.272s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Lock "cinder-quobyte-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6" released by "delete_volume" :: held 0.706s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Created reservations ['4596e908-a92a-4f07-8f12-41856a5265d5', 'e1156f50-f3b0-453c-92e3-bfce6093cc08', 'd7b9379f-4383-4f02-b425-ffdcd6b8f0f0', 'dbaf6e61-1579-41a2-a286-725592356cff'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Created reservations ['648de56a-55b5-4fac-af18-64ca201f045c', '78bcf64c-1b5e-450a-aa48-4d99917d9428', 'b11fd8bc-0b19-40d4-a07d-b370802882cc', 'c335a7a8-3436-4d51-9fed-c93e13cc0766'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] Creating offline snapshot 90af5052-bc4e-4f14-8bd3-1f19517df730 of volume e5ff4fe0-acea-4509-a9c5-47d51c763e3c {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:37:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Delete snapshot completed successfully. Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-461d075d-f818-457b-8f70-17b2ac1fd772 tempest-ProjectReaderTests-457785573 None] Lock "cinder-904dd461-93ab-476f-9f60-4df8e1fa287b-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[35516eb5-7a23-4863-ad42-9264fca20925]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:00 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:37:00 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:00 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c Sep 17 07:37:00 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:00 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.257s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:37:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Deleted volume successfully. Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-19238079-dac9-46ea-94cd-cf1db74bc203 tempest-ProjectReaderTests-1518546251 None] Lock "cinder-e5c0ed54-d521-4c9f-a50c-bb0b5bf383a6-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:00 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-25bede80-9a8d-4d84-9d77-a19e024ead8b-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c" returned: 0 in 0.432s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Lock "cinder-25bede80-9a8d-4d84-9d77-a19e024ead8b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:00 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 1G Sep 17 07:37:00 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Acquiring lock "cinder-quobyte-25bede80-9a8d-4d84-9d77-a19e024ead8b" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-25bede80-9a8d-4d84-9d77-a19e024ead8b" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b328c0da-463d-4ae5-98d1-9a8cc49e4115]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:01 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b Sep 17 07:37:01 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Flow 'volume_create_manager' (0c746874-3f83-42b8-ad61-295ea7cd2a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e9a281-e98a-4328-8994-6d4343bede53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e9a281-e98a-4328-8994-6d4343bede53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-653791378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e36d69b205b04bdba7902d55b4293c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:01Z,use_quota=True,user_id='8485f156a5494d8bab5c8aa5a30ddc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40cfa13d-2cfa-4e18-812d-f7ed4534fc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40cfa13d-2cfa-4e18-812d-f7ed4534fc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3844275b-7a7f-4b4c-bcaa-483fef1cac49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3844275b-7a7f-4b4c-bcaa-483fef1cac49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a', 'volume_name': 'volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3896a6a1-dfd7-4ce9-94a0-54fa7e3f5082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3896a6a1-dfd7-4ce9-94a0-54fa7e3f5082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f72e864-c77c-4606-bb47-795843e4143d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:01 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Volume ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a', 'volume_size': 1} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:01 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 1G" returned: 0 in 0.440s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:01 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 Sep 17 07:37:01 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:01 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b" returned: 0 in 0.401s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:01 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b Sep 17 07:37:01 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:01 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730" returned: 0 in 0.293s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:01 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 is being set with open permissions: ugo+rw Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:01 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 Sep 17 07:37:01 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:01 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-25bede80-9a8d-4d84-9d77-a19e024ead8b" returned: 0 in 0.252s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Lock "cinder-quobyte-25bede80-9a8d-4d84-9d77-a19e024ead8b" released by "delete_volume" :: held 0.741s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Created reservations ['bd68a2d7-7f99-41f8-abe5-e6083ff3154d', 'be9bf686-c45a-4cfb-aa80-2839e859e59e', 'ab80c849-484b-418f-b21b-c06d80912f1c', '704a3aad-7ddd-4734-8aa9-0f6070f1b792'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:01 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:37:01 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:01 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730" returned: 0 in 0.259s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:01 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.info Sep 17 07:37:01 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:01 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.246s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:01 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:37:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Deleted volume successfully. Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-8877c385-bd0b-4903-b3b3-84bdaaf59d9d tempest-ProjectReaderTests-457785573 None] Lock "cinder-25bede80-9a8d-4d84-9d77-a19e024ead8b-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:02 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.info" returned: 0 in 0.287s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:02 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.info is being set with open permissions: ugo+rw Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:02 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.info Sep 17 07:37:02 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:02 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.info" returned: 0 in 0.255s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.158s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-653791378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e36d69b205b04bdba7902d55b4293c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:01Z,use_quota=True,user_id='8485f156a5494d8bab5c8aa5a30ddc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Creating volume ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:37:02 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:02 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a 1073741824 Sep 17 07:37:02 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:02 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-f36a0a03-1add-4d23-ba4c-3b71496a9c6f tempest-ProjectMemberTests-78710590 None] Create snapshot completed successfully Sep 17 07:37:02 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a 1073741824" returned: 0 in 0.460s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:02 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a Sep 17 07:37:02 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:03 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a" returned: 0 in 0.276s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f72e864-c77c-4606-bb47-795843e4143d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc6e8b8-6b82-4c49-8c6b-85f09f97a2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:03 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Volume volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a (ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a): created successfully Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc6e8b8-6b82-4c49-8c6b-85f09f97a2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Flow 'volume_create_manager' (0c746874-3f83-42b8-ad61-295ea7cd2a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:03 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2159ae0f-12f2-4216-90f3-fed4fbe54028 tempest-ProjectReaderTests-1518546251 None] Created volume successfully. Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-90af5052-bc4e-4f14-8bd3-1f19517df730-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Lock "cinder-90af5052-bc4e-4f14-8bd3-1f19517df730-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-e5ff4fe0-acea-4509-a9c5-47d51c763e3c" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-e5ff4fe0-acea-4509-a9c5-47d51c763e3c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-90af5052-bc4e-4f14-8bd3-1f19517df730" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-90af5052-bc4e-4f14-8bd3-1f19517df730" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Deleting offline snapshot 90af5052-bc4e-4f14-8bd3-1f19517df730 of volume e5ff4fe0-acea-4509-a9c5-47d51c763e3c {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] snapshot_file for this snap is: volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[10550f0e-388f-45ea-b9b1-4fc40e2bd47d]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:03 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 Sep 17 07:37:03 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:03 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730" returned: 0 in 0.394s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaca69b-bc87-4b80-a7ac-0cb92e57c481]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:04 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c Sep 17 07:37:04 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "cinder-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Lock "cinder-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "cinder-quobyte-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:04 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c" returned: 0 in 0.428s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Lock "cinder-quobyte-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a" acquired by "delete_volume" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:04 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 Sep 17 07:37:04 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aea2b5-e50f-44bd-b14c-828d6e3ad26e]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:04 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a Sep 17 07:37:04 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:04 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730" returned: 0 in 0.382s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:04 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730 Sep 17 07:37:04 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:04 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:37:04 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:04 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a" returned: 0 in 0.420s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:04 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a Sep 17 07:37:04 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:05 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c.90af5052-bc4e-4f14-8bd3-1f19517df730" returned: 0 in 0.301s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:05 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.304s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-90af5052-bc4e-4f14-8bd3-1f19517df730" released by "_delete_snapshot" :: held 1.638s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-e5ff4fe0-acea-4509-a9c5-47d51c763e3c" released by "delete_snapshot" :: held 1.662s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:05 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a" returned: 0 in 0.290s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Lock "cinder-quobyte-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a" released by "delete_volume" :: held 0.775s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Created reservations ['6d35fe72-2ded-41e8-8072-43a6931e3929', 'b263250b-0af5-453a-8411-7a609aaa0d46', 'cad6fed9-4553-4c06-8da2-bb3cbc1f2f4e', '148117ad-622b-4c30-b584-359d6850cc7d'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Created reservations ['ca2f3cc4-d902-4ec3-a00c-ac6992c346e4', '3cef9148-0af7-4985-a578-505518be09de', '9ae81435-38d7-400e-8924-2e1eeaceeeae', '1e4341ce-21ad-45d4-9a0c-b46080d140aa'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:05 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Delete snapshot completed successfully. Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-31c8a008-cee7-439f-aa08-397fdd95ad99 tempest-ProjectMemberTests-78710590 None] Lock "cinder-90af5052-bc4e-4f14-8bd3-1f19517df730-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:05 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:37:05 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:05 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.266s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:37:05 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Deleted volume successfully. Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-04bc844b-483a-46dd-99f7-2ba6becf9231 tempest-ProjectReaderTests-1518546251 None] Lock "cinder-ed1b0fa8-4d96-4e6a-b3fc-0c9baab2c26a-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-e5ff4fe0-acea-4509-a9c5-47d51c763e3c-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Lock "cinder-e5ff4fe0-acea-4509-a9c5-47d51c763e3c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-e5ff4fe0-acea-4509-a9c5-47d51c763e3c" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-e5ff4fe0-acea-4509-a9c5-47d51c763e3c" acquired by "delete_volume" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3ef700-6148-44ad-b9a1-639d24ab2614]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:05 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c Sep 17 07:37:05 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:06 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c" returned: 0 in 0.387s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:06 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c Sep 17 07:37:06 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:06 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e5ff4fe0-acea-4509-a9c5-47d51c763e3c" returned: 0 in 0.307s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:06 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-e5ff4fe0-acea-4509-a9c5-47d51c763e3c" released by "delete_volume" :: held 0.776s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:06 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Created reservations ['8087ea1d-480b-4731-b087-39198b217a5f', '2c19f558-6845-4626-bb50-d474188a1f4c', 'afeff47c-f81a-4536-8596-28a238459bee', 'ca0c2932-f84f-4aaa-bf4c-a91bb92e693e'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:06 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:06 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:37:06 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:06 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.298s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:06 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:37:06 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Deleted volume successfully. Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-114cf62e-9a84-445a-b604-a152f2d375b0 tempest-ProjectMemberTests-78710590 None] Lock "cinder-e5ff4fe0-acea-4509-a9c5-47d51c763e3c-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (7524f9fa-9b7f-4bf3-b00b-4a97f25050a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da46dc7d-c153-4576-a65c-5ef5d32b8403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da46dc7d-c153-4576-a65c-5ef5d32b8403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-760856135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48032ec-293c-4425-8d85-b545449e81bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:07Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4e7b2f-5ece-40e4-9dfd-229c6b2a1da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4e7b2f-5ece-40e4-9dfd-229c6b2a1da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c5204a-e403-45dd-a3e0-a4f4da9382d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c5204a-e403-45dd-a3e0-a4f4da9382d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a48032ec-293c-4425-8d85-b545449e81bb', 'volume_name': 'volume-a48032ec-293c-4425-8d85-b545449e81bb', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed72ea22-2362-4a24-9144-c92b41deaead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed72ea22-2362-4a24-9144-c92b41deaead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d4060c3-cbac-4ee5-aeab-1e5e253d06fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:07 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Volume a48032ec-293c-4425-8d85-b545449e81bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a48032ec-293c-4425-8d85-b545449e81bb', 'volume_size': 1} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-760856135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48032ec-293c-4425-8d85-b545449e81bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:07Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Creating volume a48032ec-293c-4425-8d85-b545449e81bb {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:37:07 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:37:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:07 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb 1073741824 Sep 17 07:37:07 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:08 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb 1073741824" returned: 0 in 0.420s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:08 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb Sep 17 07:37:08 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:08 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb" returned: 0 in 0.245s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:37:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d4060c3-cbac-4ee5-aeab-1e5e253d06fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a48032ec-293c-4425-8d85-b545449e81bb', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cee8fa-1000-447e-aa9e-1afcfb89e762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:08 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Volume volume-a48032ec-293c-4425-8d85-b545449e81bb (a48032ec-293c-4425-8d85-b545449e81bb): created successfully Sep 17 07:37:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cee8fa-1000-447e-aa9e-1afcfb89e762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:08 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (7524f9fa-9b7f-4bf3-b00b-4a97f25050a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:08 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-647ec14c-a885-4073-802e-3340b542938d tempest-ProjectMemberTests-78710590 None] Created volume successfully. Sep 17 07:37:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] Creating offline snapshot 1f404e8f-93d2-4ab4-8e88-aab782c1c223 of volume a48032ec-293c-4425-8d85-b545449e81bb {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:37:09 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ef3d50-c6f1-4fc5-8f64-b1f7b6dc21c1]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:09 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb Sep 17 07:37:09 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:09 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb" returned: 0 in 0.356s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:10 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 1G Sep 17 07:37:10 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:10 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 1G" returned: 0 in 0.425s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a48032ec-293c-4425-8d85-b545449e81bb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:10 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a48032ec-293c-4425-8d85-b545449e81bb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 Sep 17 07:37:10 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:10 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a48032ec-293c-4425-8d85-b545449e81bb -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223" returned: 0 in 0.322s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:10 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 is being set with open permissions: ugo+rw Sep 17 07:37:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:10 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 Sep 17 07:37:10 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:11 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223" returned: 0 in 0.265s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:11 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.info Sep 17 07:37:11 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:11 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.info" returned: 0 in 0.266s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:11 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.info is being set with open permissions: ugo+rw Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:11 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.info Sep 17 07:37:11 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:11 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.info" returned: 0 in 0.260s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:11 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-f6c80fb6-b523-44f7-8f56-9a795558dd66 tempest-ProjectMemberTests-78710590 None] Create snapshot completed successfully Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-1f404e8f-93d2-4ab4-8e88-aab782c1c223-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Lock "cinder-1f404e8f-93d2-4ab4-8e88-aab782c1c223-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-a48032ec-293c-4425-8d85-b545449e81bb" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-a48032ec-293c-4425-8d85-b545449e81bb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-1f404e8f-93d2-4ab4-8e88-aab782c1c223" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-1f404e8f-93d2-4ab4-8e88-aab782c1c223" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Deleting offline snapshot 1f404e8f-93d2-4ab4-8e88-aab782c1c223 of volume a48032ec-293c-4425-8d85-b545449e81bb {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] snapshot_file for this snap is: volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c29e923-deab-485c-af07-6fde9c944164]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:11 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 Sep 17 07:37:11 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:12 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223" returned: 0 in 0.382s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:12 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a48032ec-293c-4425-8d85-b545449e81bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:37:12 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[1446afce-9f44-4251-8349-c94ad83e3b0c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:12 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb Sep 17 07:37:12 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:12 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb" returned: 0 in 0.386s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:12 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:12 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 Sep 17 07:37:12 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:13 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223" returned: 0 in 0.365s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:13 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223 Sep 17 07:37:13 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:13 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:13 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb.1f404e8f-93d2-4ab4-8e88-aab782c1c223" returned: 0 in 0.265s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-1f404e8f-93d2-4ab4-8e88-aab782c1c223" released by "_delete_snapshot" :: held 1.509s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-a48032ec-293c-4425-8d85-b545449e81bb" released by "delete_snapshot" :: held 1.528s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:13 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Created reservations ['a94f6bbe-6b4e-4181-a36a-6cd9e95255aa', '3bfa4be2-a0ea-4070-8390-adcd5b0afefb', 'dc6aa22d-afb9-4817-b7b0-feae2ec6429e', '6eb4ab2c-c9d4-4996-9148-2b8944d23084'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:13 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Delete snapshot completed successfully. Sep 17 07:37:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4e2b6324-a19a-4cd7-8bdf-3887c56d5164 tempest-ProjectMemberTests-78710590 None] Lock "cinder-1f404e8f-93d2-4ab4-8e88-aab782c1c223-delete_snapshot" released by "delete_snapshot" :: held 1.663s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-a48032ec-293c-4425-8d85-b545449e81bb-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Lock "cinder-a48032ec-293c-4425-8d85-b545449e81bb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:13 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-a48032ec-293c-4425-8d85-b545449e81bb" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-a48032ec-293c-4425-8d85-b545449e81bb" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:14 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaa0480-0249-4402-ae0f-78d018e694d7]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:14 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb Sep 17 07:37:14 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:14 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb" returned: 0 in 0.401s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:14 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb Sep 17 07:37:14 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:14 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a48032ec-293c-4425-8d85-b545449e81bb" returned: 0 in 0.263s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:14 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-a48032ec-293c-4425-8d85-b545449e81bb" released by "delete_volume" :: held 0.740s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:14 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Created reservations ['14641674-1f23-49eb-a8d8-d69a7d84afbc', '5921d36f-dd21-417b-bcbf-650a037292e0', 'eb32ccc5-0c5e-49d2-a53e-b168e54faf2e', 'ad83fec9-439d-4e6e-a181-c43395c69471'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:14 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:14 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:14 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:37:14 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:15 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.261s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:37:15 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Deleted volume successfully. Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-bbe57e82-9178-4b60-b168-1216dec3e16d tempest-ProjectMemberTests-78710590 None] Lock "cinder-a48032ec-293c-4425-8d85-b545449e81bb-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (57fa20cf-8d4b-4e5f-b567-08cfe1023bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f4b144-4ba8-41e8-ae7f-503d95873862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f4b144-4ba8-41e8-ae7f-503d95873862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671421589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b5c863-0caa-40d1-be28-aa6c12b29739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:16Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84b3bc4-95de-4c2e-9408-ce804d37359f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84b3bc4-95de-4c2e-9408-ce804d37359f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9364d1ec-c33f-4886-be79-a060485f6ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9364d1ec-c33f-4886-be79-a060485f6ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b5c863-0caa-40d1-be28-aa6c12b29739', 'volume_name': 'volume-d1b5c863-0caa-40d1-be28-aa6c12b29739', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad422c1-0e8e-41e4-a65e-c102b3716c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad422c1-0e8e-41e4-a65e-c102b3716c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4a0a07-dd42-491d-8479-eb1d87e0b964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:15 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Volume d1b5c863-0caa-40d1-be28-aa6c12b29739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b5c863-0caa-40d1-be28-aa6c12b29739', 'volume_size': 1} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671421589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b5c863-0caa-40d1-be28-aa6c12b29739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:16Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Creating volume d1b5c863-0caa-40d1-be28-aa6c12b29739 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:37:15 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:37:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:15 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 1073741824 Sep 17 07:37:15 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:16 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 1073741824" returned: 0 in 0.485s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:16 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 Sep 17 07:37:16 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:16 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739" returned: 0 in 0.270s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:37:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4a0a07-dd42-491d-8479-eb1d87e0b964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b5c863-0caa-40d1-be28-aa6c12b29739', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38807c2-0001-402d-9e26-e752c33d2e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:16 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Volume volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 (d1b5c863-0caa-40d1-be28-aa6c12b29739): created successfully Sep 17 07:37:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38807c2-0001-402d-9e26-e752c33d2e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (57fa20cf-8d4b-4e5f-b567-08cfe1023bc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:16 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4ae40dc0-48b1-4894-8ecd-e64e485ad244 tempest-ProjectMemberTests-78710590 None] Created volume successfully. Sep 17 07:37:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] Creating offline snapshot 51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 of volume d1b5c863-0caa-40d1-be28-aa6c12b29739 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:37:17 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[04616728-ad39-4250-91f1-c3535df34566]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:17 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 Sep 17 07:37:17 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:18 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739" returned: 0 in 0.387s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:18 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 1G Sep 17 07:37:18 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:18 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 1G" returned: 0 in 0.436s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:18 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 Sep 17 07:37:18 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:18 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1" returned: 0 in 0.313s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:18 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 is being set with open permissions: ugo+rw Sep 17 07:37:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:19 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 Sep 17 07:37:19 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:19 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1" returned: 0 in 0.250s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:19 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.info Sep 17 07:37:19 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:19 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.info" returned: 0 in 0.251s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:19 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.info is being set with open permissions: ugo+rw Sep 17 07:37:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:19 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.info Sep 17 07:37:19 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:19 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.info" returned: 0 in 0.270s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:19 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-c8aeac31-465a-4202-99e0-062413f2669c tempest-ProjectMemberTests-78710590 None] Create snapshot completed successfully Sep 17 07:37:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Lock "cinder-51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-d1b5c863-0caa-40d1-be28-aa6c12b29739" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-d1b5c863-0caa-40d1-be28-aa6c12b29739" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Deleting offline snapshot 51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 of volume d1b5c863-0caa-40d1-be28-aa6c12b29739 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:37:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] snapshot_file for this snap is: volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:37:20 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e99aeca-6c88-4e1c-8ee6-491cf4d4a45b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:20 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 Sep 17 07:37:20 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:20 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1" returned: 0 in 0.397s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:20 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1b5c863-0caa-40d1-be28-aa6c12b29739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:37:20 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab23a00-0334-4e31-97a3-a11749c640a6]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:20 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 Sep 17 07:37:20 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:20 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739" returned: 0 in 0.411s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:20 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 Sep 17 07:37:20 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:21 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1" returned: 0 in 0.349s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:21 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1 Sep 17 07:37:21 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:21 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:21 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739.51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1" returned: 0 in 0.255s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1" released by "_delete_snapshot" :: held 1.547s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-d1b5c863-0caa-40d1-be28-aa6c12b29739" released by "delete_snapshot" :: held 1.572s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:21 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Created reservations ['70d6ad70-5064-468b-94de-46fa96629450', 'fb52b113-a98b-4537-8c94-2023ea966d99', '45fc01f4-6e90-4b2a-9db1-8e06db9fc3c1', '66f37565-72a1-42aa-aab0-bd4a61ca8c25'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:21 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Delete snapshot completed successfully. Sep 17 07:37:21 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-e7bcfe4f-0df1-475b-a1e0-a4a2aec1ac10 tempest-ProjectMemberTests-78710590 None] Lock "cinder-51ffea4b-ac69-4d0d-a8c5-4a2ac4fd66b1-delete_snapshot" released by "delete_snapshot" :: held 1.732s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-d1b5c863-0caa-40d1-be28-aa6c12b29739-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Lock "cinder-d1b5c863-0caa-40d1-be28-aa6c12b29739-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-d1b5c863-0caa-40d1-be28-aa6c12b29739" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-d1b5c863-0caa-40d1-be28-aa6c12b29739" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:22 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc06c66-7625-4baf-bd8c-376e1757816b]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:22 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 Sep 17 07:37:22 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:22 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739" returned: 0 in 0.385s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:22 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739 Sep 17 07:37:22 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:22 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:22 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-d1b5c863-0caa-40d1-be28-aa6c12b29739" returned: 0 in 0.275s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:22 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-d1b5c863-0caa-40d1-be28-aa6c12b29739" released by "delete_volume" :: held 0.724s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:22 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Created reservations ['c87c44fd-aefd-44c7-ab9d-b6874f18b4f7', '8f50786d-4c17-4a07-bfc5-35e35850879f', '478ba4be-a1f2-480a-996e-a8738f98da16', 'c8541aa4-ab96-4fe4-8a59-e4a7d4ece149'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:23 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:37:23 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:23 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.260s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:37:23 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Deleted volume successfully. Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-c195fd2c-02ff-4bc8-9f5a-7937a6e8048b tempest-ProjectMemberTests-78710590 None] Lock "cinder-d1b5c863-0caa-40d1-be28-aa6c12b29739-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (1dd87da5-de0c-4add-868e-30810ef7c5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cac5719-fe63-4224-9ccf-f37832d28491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cac5719-fe63-4224-9ccf-f37832d28491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-679353208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27f0760-4d30-425f-a657-ceb0d4904f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:24Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371e4643-b7be-465e-866c-e121773e2e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371e4643-b7be-465e-866c-e121773e2e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2d24d6-d4a5-4db2-9923-87605d9da5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2d24d6-d4a5-4db2-9923-87605d9da5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27f0760-4d30-425f-a657-ceb0d4904f04', 'volume_name': 'volume-a27f0760-4d30-425f-a657-ceb0d4904f04', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9a30a9-ae72-4817-9439-6f659bd6f653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9a30a9-ae72-4817-9439-6f659bd6f653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d908d7-7755-4c8e-9149-afea32e8f78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:23 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Volume a27f0760-4d30-425f-a657-ceb0d4904f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27f0760-4d30-425f-a657-ceb0d4904f04', 'volume_size': 1} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-679353208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27f0760-4d30-425f-a657-ceb0d4904f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:24Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Creating volume a27f0760-4d30-425f-a657-ceb0d4904f04 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:37:23 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:37:23 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:23 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04 1073741824 Sep 17 07:37:23 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:24 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04 1073741824" returned: 0 in 0.460s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:24 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04 Sep 17 07:37:24 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:24 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04" returned: 0 in 0.248s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:24 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:37:24 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:24 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d908d7-7755-4c8e-9149-afea32e8f78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27f0760-4d30-425f-a657-ceb0d4904f04', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:24 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52cb74b-19b1-4100-8cb6-49a6df547382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:24 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Volume volume-a27f0760-4d30-425f-a657-ceb0d4904f04 (a27f0760-4d30-425f-a657-ceb0d4904f04): created successfully Sep 17 07:37:24 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52cb74b-19b1-4100-8cb6-49a6df547382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:24 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (1dd87da5-de0c-4add-868e-30810ef7c5dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:24 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-56407241-7414-4ff9-a27b-ba8e2b16a3ff tempest-ProjectMemberTests-78710590 None] Created volume successfully. Sep 17 07:37:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:25 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] Creating offline snapshot 8a8591e6-02e5-4544-a906-72e0d7ecc8b4 of volume a27f0760-4d30-425f-a657-ceb0d4904f04 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:37:25 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95811b8-5ce4-4376-9033-ef8469176b57]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:25 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04 Sep 17 07:37:25 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:25 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04" returned: 0 in 0.400s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:25 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 1G Sep 17 07:37:25 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:25 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 1G" returned: 0 in 0.412s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:25 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27f0760-4d30-425f-a657-ceb0d4904f04 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:25 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27f0760-4d30-425f-a657-ceb0d4904f04 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 Sep 17 07:37:25 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:26 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27f0760-4d30-425f-a657-ceb0d4904f04 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4" returned: 0 in 0.284s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:26 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 is being set with open permissions: ugo+rw Sep 17 07:37:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:26 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 Sep 17 07:37:26 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:26 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4" returned: 0 in 0.269s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:26 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.info Sep 17 07:37:26 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:26 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.info" returned: 0 in 0.348s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:26 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.info is being set with open permissions: ugo+rw Sep 17 07:37:26 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:26 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.info Sep 17 07:37:26 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:27 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.info" returned: 0 in 0.261s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:27 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:27 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-fa7addf5-c4e7-4d32-a921-f2085b8b384a tempest-ProjectMemberTests-78710590 None] Create snapshot completed successfully Sep 17 07:37:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-8a8591e6-02e5-4544-a906-72e0d7ecc8b4-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Lock "cinder-8a8591e6-02e5-4544-a906-72e0d7ecc8b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-a27f0760-4d30-425f-a657-ceb0d4904f04" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-a27f0760-4d30-425f-a657-ceb0d4904f04" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-8a8591e6-02e5-4544-a906-72e0d7ecc8b4" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:28 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-8a8591e6-02e5-4544-a906-72e0d7ecc8b4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Deleting offline snapshot 8a8591e6-02e5-4544-a906-72e0d7ecc8b4 of volume a27f0760-4d30-425f-a657-ceb0d4904f04 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:37:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] snapshot_file for this snap is: volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:37:28 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[5250c2f8-50ec-4589-8c28-18f97afb44ce]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:28 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 Sep 17 07:37:28 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:28 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4" returned: 0 in 0.413s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:28 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a27f0760-4d30-425f-a657-ceb0d4904f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:37:28 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0297194e-29ba-49f3-a4ed-3faa572a1fba]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:28 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:28 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04 Sep 17 07:37:28 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:29 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04" returned: 0 in 0.383s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:29 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 Sep 17 07:37:29 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:29 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4" returned: 0 in 0.385s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:29 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4 Sep 17 07:37:29 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:29 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:29 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04.8a8591e6-02e5-4544-a906-72e0d7ecc8b4" returned: 0 in 0.246s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-8a8591e6-02e5-4544-a906-72e0d7ecc8b4" released by "_delete_snapshot" :: held 1.548s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-a27f0760-4d30-425f-a657-ceb0d4904f04" released by "delete_snapshot" :: held 1.571s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:29 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Created reservations ['2075a017-c75b-4bb8-8700-8f76c1449059', 'ee813117-4c34-4c01-9d92-3b3677b1320a', '6cc00058-cbf9-4a6c-9de7-79588d8ffc2d', 'ed723579-d6be-436e-90e4-4ef5318ca384'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:29 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Delete snapshot completed successfully. Sep 17 07:37:29 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-41a33d61-0453-477c-9e8f-81cf30877853 tempest-ProjectMemberTests-78710590 None] Lock "cinder-8a8591e6-02e5-4544-a906-72e0d7ecc8b4-delete_snapshot" released by "delete_snapshot" :: held 1.729s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-a27f0760-4d30-425f-a657-ceb0d4904f04-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Lock "cinder-a27f0760-4d30-425f-a657-ceb0d4904f04-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-a27f0760-4d30-425f-a657-ceb0d4904f04" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:30 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-a27f0760-4d30-425f-a657-ceb0d4904f04" acquired by "delete_volume" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:30 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[485c38d1-30a0-4869-8655-3a4a49bf1a69]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:30 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04 Sep 17 07:37:30 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:30 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04" returned: 0 in 0.401s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:30 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:30 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04 Sep 17 07:37:30 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:31 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a27f0760-4d30-425f-a657-ceb0d4904f04" returned: 0 in 0.255s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-a27f0760-4d30-425f-a657-ceb0d4904f04" released by "delete_volume" :: held 0.735s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:31 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Created reservations ['e27aaa4a-7fe9-4b58-9750-f34299651ac5', 'bd56cc5f-0430-4cb8-b45c-d55d6701a711', '2f8af2ef-515a-4658-8181-1658d7c47a55', 'f0605ea3-a2d0-465d-8c20-65c425780fd9'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:31 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:31 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:37:31 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:31 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:31 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.241s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:31 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:37:31 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Deleted volume successfully. Sep 17 07:37:31 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ca8f80ef-0b45-4fe9-9957-4053d2ab379b tempest-ProjectMemberTests-78710590 None] Lock "cinder-a27f0760-4d30-425f-a657-ceb0d4904f04-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (0c0217c9-1a3e-4dd9-8dbe-d26157734f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9225c88e-8615-436d-ad53-4b82b9724b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9225c88e-8615-436d-ad53-4b82b9724b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492448909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cc49f9-5469-4acf-9812-1404756dede5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:32Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f603b84a-0d53-4ce8-8068-b4fd16ca96e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f603b84a-0d53-4ce8-8068-b4fd16ca96e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2472cd54-0a43-4781-b560-dbb8b7b139f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2472cd54-0a43-4781-b560-dbb8b7b139f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23cc49f9-5469-4acf-9812-1404756dede5', 'volume_name': 'volume-23cc49f9-5469-4acf-9812-1404756dede5', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4995e0-37d5-4c6c-b467-0b7101c608f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4995e0-37d5-4c6c-b467-0b7101c608f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef98c0aa-9875-4c29-901c-6b7f8ff0db31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:32 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Volume 23cc49f9-5469-4acf-9812-1404756dede5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23cc49f9-5469-4acf-9812-1404756dede5', 'volume_size': 1} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492448909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cc49f9-5469-4acf-9812-1404756dede5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:32Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Creating volume 23cc49f9-5469-4acf-9812-1404756dede5 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:37:32 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:32 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5 1073741824 Sep 17 07:37:32 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:32 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5 1073741824" returned: 0 in 0.452s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:32 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5 Sep 17 07:37:32 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:32 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5" returned: 0 in 0.261s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef98c0aa-9875-4c29-901c-6b7f8ff0db31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23cc49f9-5469-4acf-9812-1404756dede5', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fa2101-68d1-484e-9a7a-9db82b5c974d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:32 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Volume volume-23cc49f9-5469-4acf-9812-1404756dede5 (23cc49f9-5469-4acf-9812-1404756dede5): created successfully Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fa2101-68d1-484e-9a7a-9db82b5c974d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:32 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (0c0217c9-1a3e-4dd9-8dbe-d26157734f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:32 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d3247268-c347-4872-b938-1ff4336189d3 tempest-ProjectMemberTests-78710590 None] Created volume successfully. Sep 17 07:37:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:34 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] Creating offline snapshot 0f8d6865-33b5-4aa8-8635-d3022305b139 of volume 23cc49f9-5469-4acf-9812-1404756dede5 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:37:34 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b29347-4404-4030-9f7a-76d9c943cfdc]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:34 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5 Sep 17 07:37:34 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:34 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5" returned: 0 in 0.371s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:34 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:34 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 1G Sep 17 07:37:34 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:35 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 1G" returned: 0 in 0.447s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23cc49f9-5469-4acf-9812-1404756dede5 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:35 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23cc49f9-5469-4acf-9812-1404756dede5 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 Sep 17 07:37:35 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:35 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23cc49f9-5469-4acf-9812-1404756dede5 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139" returned: 0 in 0.298s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:35 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 is being set with open permissions: ugo+rw Sep 17 07:37:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:35 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 Sep 17 07:37:35 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:35 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139" returned: 0 in 0.238s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:35 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.info Sep 17 07:37:35 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:35 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.info" returned: 0 in 0.255s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:35 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.info is being set with open permissions: ugo+rw Sep 17 07:37:35 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:36 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.info Sep 17 07:37:36 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:36 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.info" returned: 0 in 0.268s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:36 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d1323420-2f4a-4d12-9a0a-e3f10cd161f0 tempest-ProjectMemberTests-78710590 None] Create snapshot completed successfully Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-0f8d6865-33b5-4aa8-8635-d3022305b139-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Lock "cinder-0f8d6865-33b5-4aa8-8635-d3022305b139-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-23cc49f9-5469-4acf-9812-1404756dede5" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-23cc49f9-5469-4acf-9812-1404756dede5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-0f8d6865-33b5-4aa8-8635-d3022305b139" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-0f8d6865-33b5-4aa8-8635-d3022305b139" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Deleting offline snapshot 0f8d6865-33b5-4aa8-8635-d3022305b139 of volume 23cc49f9-5469-4acf-9812-1404756dede5 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] snapshot_file for this snap is: volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ded48e-18e2-49cc-9805-c6afb84281aa]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:36 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 Sep 17 07:37:36 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:36 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139" returned: 0 in 0.383s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23cc49f9-5469-4acf-9812-1404756dede5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf0c5b0-5ede-4ca5-924b-99bf67282ce9]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:36 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:37 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5 Sep 17 07:37:37 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:37 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5" returned: 0 in 0.444s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:37 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 Sep 17 07:37:37 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:37 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139" returned: 0 in 0.402s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:37 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:37 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139 Sep 17 07:37:37 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:38 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5.0f8d6865-33b5-4aa8-8635-d3022305b139" returned: 0 in 0.251s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-0f8d6865-33b5-4aa8-8635-d3022305b139" released by "_delete_snapshot" :: held 1.606s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-23cc49f9-5469-4acf-9812-1404756dede5" released by "delete_snapshot" :: held 1.630s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:38 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=144,cinder:DELETE=14,cinder:INSERT=46,cinder:UPDATE=197 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:37:38 devstack cinder-volume[86029]: DEBUG dbcounter [-] [86029] Writing DB stats cinder:SELECT=146,cinder:INSERT=55,cinder:UPDATE=180,cinder:DELETE=19 {{(pid=86029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 07:37:38 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Created reservations ['fb96c5e8-9855-4004-a6f8-f6ced043f1b5', '914c42dd-54d6-4d88-a983-e0b422763c71', 'dc3e3d82-a712-4ffc-8eb8-c7292bf44621', '3462763d-f161-41a6-80dd-42729b82c92b'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:38 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Delete snapshot completed successfully. Sep 17 07:37:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-055b1b19-2ec6-475b-abb4-a76d255c34a5 tempest-ProjectMemberTests-78710590 None] Lock "cinder-0f8d6865-33b5-4aa8-8635-d3022305b139-delete_snapshot" released by "delete_snapshot" :: held 1.841s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-23cc49f9-5469-4acf-9812-1404756dede5-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Lock "cinder-23cc49f9-5469-4acf-9812-1404756dede5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-23cc49f9-5469-4acf-9812-1404756dede5" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:38 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-23cc49f9-5469-4acf-9812-1404756dede5" acquired by "delete_volume" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:38 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a25ebc4-ad7e-453d-b934-0c0690b48820]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:38 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:38 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5 Sep 17 07:37:38 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:39 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5" returned: 0 in 0.385s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:39 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5 Sep 17 07:37:39 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:39 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-23cc49f9-5469-4acf-9812-1404756dede5" returned: 0 in 0.280s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-23cc49f9-5469-4acf-9812-1404756dede5" released by "delete_volume" :: held 0.737s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:39 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Created reservations ['f72fa821-dec6-4a3d-bbc8-f713535e9ccb', '85c9650f-9a71-4ef3-bac4-5557df7a904c', '9759aba2-8d23-436d-853d-d3eeae7d9c49', '432a5d04-bf6b-4f6d-881f-07c2277b70d0'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:39 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:39 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:39 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:37:39 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:39 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:39 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.294s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:39 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:37:39 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Deleted volume successfully. Sep 17 07:37:39 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-2b746a34-3b26-464e-bde5-3b0dd86f2940 tempest-ProjectMemberTests-78710590 None] Lock "cinder-23cc49f9-5469-4acf-9812-1404756dede5-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (8838ecee-e522-4ca4-99b0-7a7f4a299e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d48e8a4-e520-4ace-af34-6d0dea2fe449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d48e8a4-e520-4ace-af34-6d0dea2fe449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1073487124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85203dc1-fa97-4e18-8c52-0b311d1d0b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:40Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e88faab-b8fe-42ba-b4a6-225f02efee66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e88faab-b8fe-42ba-b4a6-225f02efee66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72eeb37d-67f9-4a95-b5ce-a0046cc22d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72eeb37d-67f9-4a95-b5ce-a0046cc22d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85203dc1-fa97-4e18-8c52-0b311d1d0b73', 'volume_name': 'volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c5bae9-4b23-4d21-8cfb-d704225a854b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c5bae9-4b23-4d21-8cfb-d704225a854b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef64d45-d7b6-4a54-a253-ecd7922e11ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:40 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Volume 85203dc1-fa97-4e18-8c52-0b311d1d0b73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73', 'volume_size': 1} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1073487124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85203dc1-fa97-4e18-8c52-0b311d1d0b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:40Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Creating volume 85203dc1-fa97-4e18-8c52-0b311d1d0b73 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:37:40 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:40 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 1073741824 Sep 17 07:37:40 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:40 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 1073741824" returned: 0 in 0.489s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:40 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:40 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 Sep 17 07:37:40 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:41 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73" returned: 0 in 0.250s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:41 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:37:41 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef64d45-d7b6-4a54-a253-ecd7922e11ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a17995-b786-41bc-9244-c5c35fe2f8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:41 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Volume volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 (85203dc1-fa97-4e18-8c52-0b311d1d0b73): created successfully Sep 17 07:37:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a17995-b786-41bc-9244-c5c35fe2f8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:41 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (8838ecee-e522-4ca4-99b0-7a7f4a299e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:41 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-b11647fd-71e6-4026-8138-7ef73f8380b5 tempest-ProjectMemberTests-78710590 None] Created volume successfully. Sep 17 07:37:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:42 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] Creating offline snapshot b29517c0-9a3c-421a-af7f-90ed38fdd0f5 of volume 85203dc1-fa97-4e18-8c52-0b311d1d0b73 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:37:42 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b494ce5a-71f3-4d5e-a3f4-d0440f1902c9]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:42 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 Sep 17 07:37:42 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:42 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73" returned: 0 in 0.397s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:42 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:43 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 1G Sep 17 07:37:43 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Flow 'volume_create_manager' (33fe15ed-89e6-4624-a31a-324c92cfff8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b330d1fe-7923-46a9-9934-5cb397e4f524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b330d1fe-7923-46a9-9934-5cb397e4f524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1502480751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111c382e-84e0-45e0-9f8e-c49d9d699c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d002fd13972f4bd9a1a8e5ca878080d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:43Z,use_quota=True,user_id='4c43be66af62493baed1b20341e7d550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a519c3-f42b-4c2f-b9a6-f437c2d586a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a519c3-f42b-4c2f-b9a6-f437c2d586a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34f0c55-8ddf-4bbe-ad08-1f627b45960b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34f0c55-8ddf-4bbe-ad08-1f627b45960b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '111c382e-84e0-45e0-9f8e-c49d9d699c53', 'volume_name': 'volume-111c382e-84e0-45e0-9f8e-c49d9d699c53', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0aa808f-1b01-426d-8779-cac2be51f202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0aa808f-1b01-426d-8779-cac2be51f202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4abfe2-400d-4b73-9cb1-60bd64a66d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:43 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Volume 111c382e-84e0-45e0-9f8e-c49d9d699c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-111c382e-84e0-45e0-9f8e-c49d9d699c53', 'volume_size': 1} Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:43 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 1G" returned: 0 in 0.407s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:43 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 Sep 17 07:37:43 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:43 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5" returned: 0 in 0.292s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:43 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 is being set with open permissions: ugo+rw Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:43 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 Sep 17 07:37:43 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:43 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5" returned: 0 in 0.255s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:43 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:44 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.info Sep 17 07:37:44 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:44 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.info" returned: 0 in 0.244s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:44 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.info is being set with open permissions: ugo+rw Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:44 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.info Sep 17 07:37:44 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:44 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.info" returned: 0 in 0.247s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.323s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1502480751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111c382e-84e0-45e0-9f8e-c49d9d699c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d002fd13972f4bd9a1a8e5ca878080d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:43Z,use_quota=True,user_id='4c43be66af62493baed1b20341e7d550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Creating volume 111c382e-84e0-45e0-9f8e-c49d9d699c53 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:37:44 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:44 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 1073741824 Sep 17 07:37:44 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:44 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d210b84a-6a13-4ba0-b10c-112dd118422b tempest-ProjectMemberTests-78710590 None] Create snapshot completed successfully Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-b29517c0-9a3c-421a-af7f-90ed38fdd0f5-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Lock "cinder-b29517c0-9a3c-421a-af7f-90ed38fdd0f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-85203dc1-fa97-4e18-8c52-0b311d1d0b73" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-85203dc1-fa97-4e18-8c52-0b311d1d0b73" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-b29517c0-9a3c-421a-af7f-90ed38fdd0f5" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-b29517c0-9a3c-421a-af7f-90ed38fdd0f5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Deleting offline snapshot b29517c0-9a3c-421a-af7f-90ed38fdd0f5 of volume 85203dc1-fa97-4e18-8c52-0b311d1d0b73 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] snapshot_file for this snap is: volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4b0707-ba58-470c-ad04-0508ea7caedc]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:44 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 Sep 17 07:37:44 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:44 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:44 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 1073741824" returned: 0 in 0.491s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:45 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 Sep 17 07:37:45 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:45 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5" returned: 0 in 0.395s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe838c8-4db7-4736-b4f8-30385c404392]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:45 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53" returned: 0 in 0.271s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4abfe2-400d-4b73-9cb1-60bd64a66d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111c382e-84e0-45e0-9f8e-c49d9d699c53', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb56f27-9ad9-4cdc-b6e8-24111cc78741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:45 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Volume volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 (111c382e-84e0-45e0-9f8e-c49d9d699c53): created successfully Sep 17 07:37:45 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb56f27-9ad9-4cdc-b6e8-24111cc78741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:45 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Flow 'volume_create_manager' (33fe15ed-89e6-4624-a31a-324c92cfff8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:45 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2bafcc12-9042-4165-8f97-96b3b02ccbff tempest-SnapshotDependencyTests-1205662098 None] Created volume successfully. Sep 17 07:37:45 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73" returned: 0 in 0.370s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:45 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 Sep 17 07:37:45 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:45 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5" returned: 0 in 0.324s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:45 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:45 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5 Sep 17 07:37:45 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:46 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73.b29517c0-9a3c-421a-af7f-90ed38fdd0f5" returned: 0 in 0.261s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-b29517c0-9a3c-421a-af7f-90ed38fdd0f5" released by "_delete_snapshot" :: held 1.470s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-85203dc1-fa97-4e18-8c52-0b311d1d0b73" released by "delete_snapshot" :: held 1.498s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Created reservations ['6bcffb1d-7582-4c9e-b93b-8d94d5e98285', 'f583ee3e-6406-4235-bfa5-cf82bb76b230', '18806e0a-bd8a-4e19-8b56-65736c5346bd', 'be28f28e-0920-475d-a7b6-2c2fae7557e1'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:46 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Delete snapshot completed successfully. Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-ac460cde-f11c-41e8-ae3f-64d661d4901d tempest-ProjectMemberTests-78710590 None] Lock "cinder-b29517c0-9a3c-421a-af7f-90ed38fdd0f5-delete_snapshot" released by "delete_snapshot" :: held 1.688s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] Creating offline snapshot ef413d04-6f1d-4018-a122-ec86ca13c5c0 of volume 111c382e-84e0-45e0-9f8e-c49d9d699c53 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[b987e731-b91b-4088-b63d-fd21611f08fe]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:46 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 Sep 17 07:37:46 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-85203dc1-fa97-4e18-8c52-0b311d1d0b73-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Lock "cinder-85203dc1-fa97-4e18-8c52-0b311d1d0b73-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-85203dc1-fa97-4e18-8c52-0b311d1d0b73" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-85203dc1-fa97-4e18-8c52-0b311d1d0b73" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:46 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53" returned: 0 in 0.389s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[154863a2-b003-4ad6-9b39-7631bf809925]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:46 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:46 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 1G Sep 17 07:37:46 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:47 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 Sep 17 07:37:47 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:47 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73" returned: 0 in 0.373s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:47 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 1G" returned: 0 in 0.400s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:47 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73 Sep 17 07:37:47 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:47 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 Sep 17 07:37:47 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:47 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-85203dc1-fa97-4e18-8c52-0b311d1d0b73" returned: 0 in 0.246s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-85203dc1-fa97-4e18-8c52-0b311d1d0b73" released by "delete_volume" :: held 0.685s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:47 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0" returned: 0 in 0.294s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:47 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 is being set with open permissions: ugo+rw Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Created reservations ['69d94bb6-5d1f-442a-987c-b9381c453473', '485945ba-e549-4310-bce1-6dfaa9b3d626', '1d32222a-019c-470c-b94c-e576da9b3c77', 'eda13031-f56d-435d-b725-474279dca3e8'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:47 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 Sep 17 07:37:47 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:47 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:37:47 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:47 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0" returned: 0 in 0.255s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:47 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:47 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.info Sep 17 07:37:47 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:48 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.269s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:37:48 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Deleted volume successfully. Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-798ab467-6d89-4b49-aa0d-72a512e2fb72 tempest-ProjectMemberTests-78710590 None] Lock "cinder-85203dc1-fa97-4e18-8c52-0b311d1d0b73-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:48 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.info" returned: 0 in 0.266s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:48 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.info is being set with open permissions: ugo+rw Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:48 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.info Sep 17 07:37:48 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:48 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.info" returned: 0 in 0.261s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (90358963-981d-4393-b739-a568ca1e6179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02d2d87-d809-49fa-9916-48ce877e5d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:48 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4cda33fb-cc10-4128-b1c1-c02fb102bf5e tempest-SnapshotDependencyTests-1205662098 None] Create snapshot completed successfully Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02d2d87-d809-49fa-9916-48ce877e5d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1660251028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:48Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51274605-45f6-49d2-845a-8edd2e10f3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51274605-45f6-49d2-845a-8edd2e10f3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0802923-f48b-45dd-83f4-8e993215269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0802923-f48b-45dd-83f4-8e993215269b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc', 'volume_name': 'volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c961e6bd-13ab-4c98-9641-57d0165525f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c961e6bd-13ab-4c98-9641-57d0165525f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e356b435-17ec-46b6-af81-e31b4201a891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:48 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Volume f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc', 'volume_size': 1} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1660251028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:48Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Creating volume f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:37:48 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:37:48 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:48 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc 1073741824 Sep 17 07:37:48 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:49 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc 1073741824" returned: 0 in 0.476s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:49 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc Sep 17 07:37:49 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Flow 'volume_create_manager' (4e247c93-9116-4c9e-910d-895730ff6d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6df5580-5963-482c-9c43-14143346e8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6df5580-5963-482c-9c43-14143346e8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41dfa3a-b886-407b-8911-492a5e56c9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d002fd13972f4bd9a1a8e5ca878080d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ef413d04-6f1d-4018-a122-ec86ca13c5c0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:37:49Z,use_quota=True,user_id='4c43be66af62493baed1b20341e7d550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92929cbe-a445-424c-8589-7f2ca94ee99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92929cbe-a445-424c-8589-7f2ca94ee99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d4c007-3a7e-4913-8b80-51fbc3b88c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d4c007-3a7e-4913-8b80-51fbc3b88c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a41dfa3a-b886-407b-8911-492a5e56c9e2', 'volume_name': 'volume-a41dfa3a-b886-407b-8911-492a5e56c9e2', 'volume_size': 1, 'snapshot_id': 'ef413d04-6f1d-4018-a122-ec86ca13c5c0'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529fad9b-aa14-43e0-8e25-522f8fe4138f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529fad9b-aa14-43e0-8e25-522f8fe4138f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c060c06b-af53-48a5-bace-737f3dc312c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:49 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Volume a41dfa3a-b886-407b-8911-492a5e56c9e2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a41dfa3a-b886-407b-8911-492a5e56c9e2', 'volume_size': 1, 'snapshot_id': 'ef413d04-6f1d-4018-a122-ec86ca13c5c0'} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:49 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc" returned: 0 in 0.262s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.051s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "cinder-quobyte-ef413d04-6f1d-4018-a122-ec86ca13c5c0-a41dfa3a-b886-407b-8911-492a5e56c9e2" by "_create_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e356b435-17ec-46b6-af81-e31b4201a891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb05d88f-88e6-43db-b216-b3e5aef3a9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-quobyte-ef413d04-6f1d-4018-a122-ec86ca13c5c0-a41dfa3a-b886-407b-8911-492a5e56c9e2" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Creating volume a41dfa3a-b886-407b-8911-492a5e56c9e2 from snapshot ef413d04-6f1d-4018-a122-ec86ca13c5c0 {{(pid=86029) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "cinder-quobyte-a41dfa3a-b886-407b-8911-492a5e56c9e2" by "_copy_volume_from_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:49 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Volume volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc (f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc): created successfully Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb05d88f-88e6-43db-b216-b3e5aef3a9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (90358963-981d-4393-b739-a568ca1e6179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-quobyte-a41dfa3a-b886-407b-8911-492a5e56c9e2" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] snapshot: ef413d04-6f1d-4018-a122-ec86ca13c5c0, volume: a41dfa3a-b886-407b-8911-492a5e56c9e2, {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 07:37:49 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cdd5d135-de79-4f91-b9ae-79c921d83f76 tempest-ProjectMemberTests-78710590 None] Created volume successfully. Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[27367a30-5f20-487f-b658-7041d855d8b9]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:49 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 Sep 17 07:37:49 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:49 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0" returned: 0 in 0.359s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c382e-84e0-45e0-9f8e-c49d9d699c53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef53629-8a44-4988-88fb-bd883c5cd04c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:49 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:49 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 Sep 17 07:37:49 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:50 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53" returned: 0 in 0.364s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] will copy from snapshot at /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 07:37:50 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Creating direct copy from snapshot {{(pid=86029) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 07:37:50 devstack cinder-volume[86029]: DEBUG cinder.utils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Path /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2 not found in is_blk_device check {{(pid=86029) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 07:37:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:50 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2 Sep 17 07:37:50 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:50 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:37:56 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2" returned: 0 in 5.984s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG cinder.image.image_utils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Image conversion details: src /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2 {{(pid=86029) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 07:37:56 devstack cinder-volume[86029]: INFO cinder.image.image_utils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Converted 1024.00 MB image at 171.08 MB/s Sep 17 07:37:56 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2 is being set with open permissions: ugo+rw Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:56 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2 Sep 17 07:37:56 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:56 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2" returned: 0 in 0.245s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-quobyte-a41dfa3a-b886-407b-8911-492a5e56c9e2" released by "_copy_volume_from_snapshot" :: held 7.033s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-quobyte-ef413d04-6f1d-4018-a122-ec86ca13c5c0-a41dfa3a-b886-407b-8911-492a5e56c9e2" released by "_create_volume_from_snapshot" :: held 7.104s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.127s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.805s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] Creating offline snapshot f6089c88-d92b-4f8e-9efc-9b93aa80449f of volume f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c060c06b-af53-48a5-bace-737f3dc312c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41dfa3a-b886-407b-8911-492a5e56c9e2', 'volume_size': 1, 'snapshot_id': 'ef413d04-6f1d-4018-a122-ec86ca13c5c0'}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253e97b6-a52c-4758-a5b6-5250cf8fc42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c5e093-29d8-4d25-8cb5-14726cff33e0]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:56 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Volume volume-a41dfa3a-b886-407b-8911-492a5e56c9e2 (a41dfa3a-b886-407b-8911-492a5e56c9e2): created successfully Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253e97b6-a52c-4758-a5b6-5250cf8fc42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Flow 'volume_create_manager' (4e247c93-9116-4c9e-910d-895730ff6d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:37:56 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-079cba1b-2a3b-4088-ad80-a893be373164 tempest-SnapshotDependencyTests-1205662098 None] Created volume successfully. Sep 17 07:37:56 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc Sep 17 07:37:56 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:56 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc" returned: 0 in 0.373s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "cinder-ef413d04-6f1d-4018-a122-ec86ca13c5c0-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:56 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f 1G Sep 17 07:37:56 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-ef413d04-6f1d-4018-a122-ec86ca13c5c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:56 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "cinder-quobyte-111c382e-84e0-45e0-9f8e-c49d9d699c53" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-quobyte-111c382e-84e0-45e0-9f8e-c49d9d699c53" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "cinder-quobyte-ef413d04-6f1d-4018-a122-ec86ca13c5c0" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-quobyte-ef413d04-6f1d-4018-a122-ec86ca13c5c0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Deleting offline snapshot ef413d04-6f1d-4018-a122-ec86ca13c5c0 of volume 111c382e-84e0-45e0-9f8e-c49d9d699c53 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] snapshot_file for this snap is: volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[9021191a-73e8-4531-ac6c-08619982a59c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:57 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 Sep 17 07:37:57 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:57 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f 1G" returned: 0 in 0.400s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:57 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f Sep 17 07:37:57 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:57 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0" returned: 0 in 0.378s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c382e-84e0-45e0-9f8e-c49d9d699c53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e37d95-39dd-48e9-8fa8-3a77a9d3b486]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:57 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 Sep 17 07:37:57 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:57 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f" returned: 0 in 0.300s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:57 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f is being set with open permissions: ugo+rw Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:57 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f Sep 17 07:37:57 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:57 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f" returned: 0 in 0.245s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:57 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:57 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.info Sep 17 07:37:57 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:58 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53" returned: 0 in 0.544s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:58 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 Sep 17 07:37:58 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:58 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.info" returned: 0 in 0.255s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:58 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.info is being set with open permissions: ugo+rw Sep 17 07:37:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:58 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.info Sep 17 07:37:58 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:58 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0" returned: 0 in 0.348s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:58 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0 Sep 17 07:37:58 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:58 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.info" returned: 0 in 0.246s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:37:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-a986c2b2-3cc1-4d4f-8603-7c03dfcd3327 tempest-ProjectMemberTests-78710590 None] Create snapshot completed successfully Sep 17 07:37:58 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:58 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53.ef413d04-6f1d-4018-a122-ec86ca13c5c0" returned: 0 in 0.249s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-quobyte-ef413d04-6f1d-4018-a122-ec86ca13c5c0" released by "_delete_snapshot" :: held 1.628s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-quobyte-111c382e-84e0-45e0-9f8e-c49d9d699c53" released by "delete_snapshot" :: held 1.648s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:58 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Created reservations ['9e6e18d7-529b-422f-aefa-63f882107f87', 'fca94d4a-299f-4a26-8252-edc58fa549b6', '120d7170-997e-46b4-9bf3-0a6b68348518', '24dff8fa-998c-4d41-b48e-bcc4c2f89893'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:37:58 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Delete snapshot completed successfully. Sep 17 07:37:58 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-86e173d3-c265-4217-862e-2b1cab2ad056 tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-ef413d04-6f1d-4018-a122-ec86ca13c5c0-delete_snapshot" released by "delete_snapshot" :: held 1.774s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "cinder-111c382e-84e0-45e0-9f8e-c49d9d699c53-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-111c382e-84e0-45e0-9f8e-c49d9d699c53-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "cinder-quobyte-111c382e-84e0-45e0-9f8e-c49d9d699c53" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-f6089c88-d92b-4f8e-9efc-9b93aa80449f-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-quobyte-111c382e-84e0-45e0-9f8e-c49d9d699c53" acquired by "delete_volume" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Lock "cinder-f6089c88-d92b-4f8e-9efc-9b93aa80449f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[214ad1f5-c80d-441a-8374-f686ff9e5c29]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-f6089c88-d92b-4f8e-9efc-9b93aa80449f" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-f6089c88-d92b-4f8e-9efc-9b93aa80449f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Deleting offline snapshot f6089c88-d92b-4f8e-9efc-9b93aa80449f of volume f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] snapshot_file for this snap is: volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[d501b604-7630-4068-aa22-a79d4936d891]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:59 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 Sep 17 07:37:59 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:59 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f Sep 17 07:37:59 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:59 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53" returned: 0 in 0.373s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:59 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53 Sep 17 07:37:59 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:59 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f" returned: 0 in 0.372s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[6054da45-9905-457c-93ed-7b5eec14e812]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:37:59 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc Sep 17 07:37:59 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:59 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-111c382e-84e0-45e0-9f8e-c49d9d699c53" returned: 0 in 0.256s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-quobyte-111c382e-84e0-45e0-9f8e-c49d9d699c53" released by "delete_volume" :: held 0.704s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:37:59 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Created reservations ['df8b732e-6b41-4b3d-8802-4a222570e73e', '732b954d-7c2a-44aa-99c3-e65b4f66e12a', 'c7a1042c-3c19-4b3d-979d-862cfeacb26c', 'c6a7f6d7-732d-489f-826d-1797298d409c'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:00 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:38:00 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:00 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc" returned: 0 in 0.364s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:00 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f Sep 17 07:38:00 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:00 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.265s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:38:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Deleted volume successfully. Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "cinder-a41dfa3a-b886-407b-8911-492a5e56c9e2-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-a41dfa3a-b886-407b-8911-492a5e56c9e2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-4ef5a2ef-b30a-4d13-9146-9338fccd031d tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-111c382e-84e0-45e0-9f8e-c49d9d699c53-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "cinder-quobyte-a41dfa3a-b886-407b-8911-492a5e56c9e2" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-quobyte-a41dfa3a-b886-407b-8911-492a5e56c9e2" acquired by "delete_volume" :: waited 0.014s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d19ecb5-13a3-4941-bb82-6e0d06dbc5f0]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:00 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f" returned: 0 in 0.374s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:00 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f Sep 17 07:38:00 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:00 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2 Sep 17 07:38:00 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:00 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc.f6089c88-d92b-4f8e-9efc-9b93aa80449f" returned: 0 in 0.267s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-f6089c88-d92b-4f8e-9efc-9b93aa80449f" released by "_delete_snapshot" :: held 1.490s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc" released by "delete_snapshot" :: held 1.514s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:00 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2" returned: 0 in 0.379s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:00 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2 Sep 17 07:38:00 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Created reservations ['d9d3caab-50a9-47b4-a892-54404165730d', '2d387f5b-68c6-4415-a295-dea66e83ea3f', '3f6ddefe-203b-4aea-beea-4c841f42e1e1', 'f5b451f7-3001-4be9-85b6-8fda2925d6dd'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:38:00 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Delete snapshot completed successfully. Sep 17 07:38:00 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-55953fca-36d7-4323-bc93-6802b0c1ca4c tempest-ProjectMemberTests-78710590 None] Lock "cinder-f6089c88-d92b-4f8e-9efc-9b93aa80449f-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:01 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-a41dfa3a-b886-407b-8911-492a5e56c9e2" returned: 0 in 0.248s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-quobyte-a41dfa3a-b886-407b-8911-492a5e56c9e2" released by "delete_volume" :: held 0.666s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Created reservations ['1a71b186-94ec-4403-92e5-b64b02dec0a0', '138ad04f-f977-4e17-9ed9-f4ccfb1f4123', 'cae11c4f-6d6c-407c-8a38-6bace4aa6946', 'fc49e5f2-6f0f-474b-ac77-e27cbc954f22'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:01 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:38:01 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Lock "cinder-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:38:01 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.254s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:38:01 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Deleted volume successfully. Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d1247642-0abe-42a1-866a-f316645393b6 tempest-SnapshotDependencyTests-1205662098 None] Lock "cinder-a41dfa3a-b886-407b-8911-492a5e56c9e2-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc" acquired by "delete_volume" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd878b1-7904-4301-babf-07845d27120f]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:01 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc Sep 17 07:38:01 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:01 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc" returned: 0 in 0.373s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:01 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:01 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc Sep 17 07:38:01 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:02 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc" returned: 0 in 0.258s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc" released by "delete_volume" :: held 0.708s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:02 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Created reservations ['ee1cc23e-5a4b-4354-868c-428c95b612dc', '23df0a4e-ad48-4b08-a75f-7725646097ef', '326c4c40-f6f0-472d-b746-d020c59ec392', '51e431a1-79eb-4cd5-9b00-e2b6ca9227d3'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:38:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:38:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:38:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:38:02 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:38:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:38:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:02 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:38:02 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:02 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:02 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.269s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:02 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:38:02 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Deleted volume successfully. Sep 17 07:38:02 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-1a20dd83-1b3a-4b29-8cd7-04c100815df1 tempest-ProjectMemberTests-78710590 None] Lock "cinder-f2cb827f-0f9a-4a74-8335-a3dd5a54d2cc-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (e4316f98-3e8b-4949-991f-a51464db4f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73967e7d-5d7b-48c8-b05e-6e92e53b3a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73967e7d-5d7b-48c8-b05e-6e92e53b3a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1979272981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a7f4a5-9fab-4f98-a761-b504152552b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:38:03Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7a0444-a149-4874-8c70-196a3481a639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7a0444-a149-4874-8c70-196a3481a639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ebde5f-a95e-4e5c-99eb-a43dd3b389d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ebde5f-a95e-4e5c-99eb-a43dd3b389d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a7f4a5-9fab-4f98-a761-b504152552b4', 'volume_name': 'volume-88a7f4a5-9fab-4f98-a761-b504152552b4', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff90ecd-c2f9-488b-b4f4-b07fe4b66a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff90ecd-c2f9-488b-b4f4-b07fe4b66a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6037f6-a2e9-45e0-a853-3bfacf0abf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:03 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Volume 88a7f4a5-9fab-4f98-a761-b504152552b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a7f4a5-9fab-4f98-a761-b504152552b4', 'volume_size': 1} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1979272981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a7f4a5-9fab-4f98-a761-b504152552b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9b3a19b2a0453198e2100cc9c7a571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:38:03Z,use_quota=True,user_id='f9200b4e104e471587780c1e20272fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Creating volume 88a7f4a5-9fab-4f98-a761-b504152552b4 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:38:03 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:03 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4 1073741824 Sep 17 07:38:03 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:03 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4 1073741824" returned: 0 in 0.463s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:03 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4 Sep 17 07:38:03 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:03 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4" returned: 0 in 0.264s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6037f6-a2e9-45e0-a853-3bfacf0abf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a7f4a5-9fab-4f98-a761-b504152552b4', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726eb2e2-fd39-41cf-bad4-9d5e400083ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:03 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Volume volume-88a7f4a5-9fab-4f98-a761-b504152552b4 (88a7f4a5-9fab-4f98-a761-b504152552b4): created successfully Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726eb2e2-fd39-41cf-bad4-9d5e400083ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:03 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Flow 'volume_create_manager' (e4316f98-3e8b-4949-991f-a51464db4f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:38:03 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-cd31f775-5dd8-4459-8cf6-b4594b5e34d7 tempest-ProjectMemberTests-78710590 None] Created volume successfully. Sep 17 07:38:04 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:38:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:38:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:38:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:38:04 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:38:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:38:04 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:04 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:38:04 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:05 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.287s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:05 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:38:05 devstack cinder-volume[86029]: DEBUG oslo_service.periodic_task [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] Running periodic task VolumeManager._thread_info {{(pid=86029) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 07:38:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread count: 28 {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 07:38:05 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-ef1d1f10-35db-404f-96c1-5f3b1cc362c2 None None] thread info: [<_MainThread(MainThread, started 133336890892416)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86029) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 07:38:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:38:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:38:05 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] Creating offline snapshot 48daefd1-4ac7-42a2-aaec-e7e1a136c500 of volume 88a7f4a5-9fab-4f98-a761-b504152552b4 {{(pid=86029) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 07:38:05 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcea4ce-73ad-4da4-a4fd-86d7de827709]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:38:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:05 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4 Sep 17 07:38:05 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:05 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4" returned: 0 in 0.432s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:05 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 1G {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:05 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 1G Sep 17 07:38:05 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:06 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 1G" returned: 0 in 0.437s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a7f4a5-9fab-4f98-a761-b504152552b4 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:06 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a7f4a5-9fab-4f98-a761-b504152552b4 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 Sep 17 07:38:06 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:06 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a7f4a5-9fab-4f98-a761-b504152552b4 -F qcow2 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500" returned: 0 in 0.322s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:06 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 is being set with open permissions: ugo+rw Sep 17 07:38:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:06 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 Sep 17 07:38:06 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:06 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500" returned: 0 in 0.260s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:06 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:06 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.info Sep 17 07:38:06 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:07 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.info" returned: 0 in 0.248s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:07 devstack cinder-volume[86029]: WARNING cinder.volume.drivers.remotefs [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.info is being set with open permissions: ugo+rw Sep 17 07:38:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.info {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:07 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.info Sep 17 07:38:07 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:07 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.info" returned: 0 in 0.276s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:07 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:38:07 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-ea38196e-4e6a-41f2-8611-fbd9c2bcb2ca tempest-ProjectMemberTests-78710590 None] Create snapshot completed successfully Sep 17 07:38:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-48daefd1-4ac7-42a2-aaec-e7e1a136c500-delete_snapshot" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:38:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Lock "cinder-48daefd1-4ac7-42a2-aaec-e7e1a136c500-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:38:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-88a7f4a5-9fab-4f98-a761-b504152552b4" by "delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:38:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-88a7f4a5-9fab-4f98-a761-b504152552b4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:38:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-48daefd1-4ac7-42a2-aaec-e7e1a136c500" by "_delete_snapshot" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:38:08 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-48daefd1-4ac7-42a2-aaec-e7e1a136c500" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:38:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Deleting offline snapshot 48daefd1-4ac7-42a2-aaec-e7e1a136c500 of volume 88a7f4a5-9fab-4f98-a761-b504152552b4 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 07:38:08 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] snapshot_file for this snap is: volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 {{(pid=86029) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 07:38:08 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ea7730-aba6-4a68-a088-8d89ece88acf]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:38:08 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:08 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 Sep 17 07:38:08 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:09 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500" returned: 0 in 0.418s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:09 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88a7f4a5-9fab-4f98-a761-b504152552b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86029) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 07:38:09 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[00acab97-d417-4966-93c9-ca70b2eb53bc]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:38:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:09 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4 Sep 17 07:38:09 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:09 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4" returned: 0 in 0.378s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:09 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 Sep 17 07:38:09 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:09 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500" returned: 0 in 0.380s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:09 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:09 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500 Sep 17 07:38:09 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:10 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4.48daefd1-4ac7-42a2-aaec-e7e1a136c500" returned: 0 in 0.263s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-48daefd1-4ac7-42a2-aaec-e7e1a136c500" released by "_delete_snapshot" :: held 1.543s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-88a7f4a5-9fab-4f98-a761-b504152552b4" released by "delete_snapshot" :: held 1.564s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:10 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Created reservations ['4cb3a00b-5d0d-4ec2-91b1-615ec8456850', 'a874cff6-e4f7-4a57-a980-fa4663c7010b', '852c9fb2-da56-4ab5-bea6-91b93ad7d7de', 'e2adb96c-ea0d-4818-afcb-3ef3b095e190'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:38:10 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Delete snapshot completed successfully. Sep 17 07:38:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-84a0a0b6-be8b-46f1-9d31-6a3c48e29ca2 tempest-ProjectMemberTests-78710590 None] Lock "cinder-48daefd1-4ac7-42a2-aaec-e7e1a136c500-delete_snapshot" released by "delete_snapshot" :: held 1.712s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-88a7f4a5-9fab-4f98-a761-b504152552b4-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:38:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Lock "cinder-88a7f4a5-9fab-4f98-a761-b504152552b4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:38:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Acquiring lock "cinder-quobyte-88a7f4a5-9fab-4f98-a761-b504152552b4" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:38:10 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-88a7f4a5-9fab-4f98-a761-b504152552b4" acquired by "delete_volume" :: waited 0.030s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:38:10 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec2107b-9f94-405b-9c26-3a3374c07d45]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:38:10 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:11 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4 Sep 17 07:38:11 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:11 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4" returned: 0 in 0.388s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:11 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4 Sep 17 07:38:11 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:11 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-88a7f4a5-9fab-4f98-a761-b504152552b4" returned: 0 in 0.256s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Lock "cinder-quobyte-88a7f4a5-9fab-4f98-a761-b504152552b4" released by "delete_volume" :: held 0.727s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:11 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Created reservations ['8e2d18f3-df4f-45ef-8995-4ab6f348571e', '84248f09-39db-49e0-b07e-8077871c5c59', '8a3e5a83-27f4-4513-87ba-62299d469d6b', 'c11bc5dc-db6f-4c6a-a206-0648f424cfe3'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:38:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:38:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:38:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:38:11 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:38:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:38:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:11 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:38:11 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:11 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:11 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.255s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:11 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:38:11 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Deleted volume successfully. Sep 17 07:38:11 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-d94c7f22-806b-49ce-821a-48f0cc13c93d tempest-ProjectMemberTests-78710590 None] Lock "cinder-88a7f4a5-9fab-4f98-a761-b504152552b4-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Flow 'volume_create_manager' (a3512810-4626-4e62-b8a5-7b08b2155035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e656a5-07f1-471b-a72a-b9a78e5755e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e656a5-07f1-471b-a72a-b9a78e5755e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1861178029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9accc9e5-3eee-4ddd-8e81-488aff3b455f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2543a3eeda4ae28632361eea2bfd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:38:15Z,use_quota=True,user_id='dae4c69a4fd54d5d91d3f14fc874a80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ae9edd-a445-416a-b8cc-1c00181d920c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ae9edd-a445-416a-b8cc-1c00181d920c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f012c0b-20ad-4df8-86d7-32924b1d701d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f012c0b-20ad-4df8-86d7-32924b1d701d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9accc9e5-3eee-4ddd-8e81-488aff3b455f', 'volume_name': 'volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048c37b3-b862-481d-b5a4-4840c00ab368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048c37b3-b862-481d-b5a4-4840c00ab368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ced3560-dc65-4e86-9b95-d900a8f1cb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:15 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Volume 9accc9e5-3eee-4ddd-8e81-488aff3b455f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f', 'volume_size': 1} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1861178029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9accc9e5-3eee-4ddd-8e81-488aff3b455f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2543a3eeda4ae28632361eea2bfd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:38:15Z,use_quota=True,user_id='dae4c69a4fd54d5d91d3f14fc874a80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Creating volume 9accc9e5-3eee-4ddd-8e81-488aff3b455f {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:38:15 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:15 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f 1073741824 Sep 17 07:38:15 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:15 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f 1073741824" returned: 0 in 0.415s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:15 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:15 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f Sep 17 07:38:15 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:16 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f" returned: 0 in 0.239s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ced3560-dc65-4e86-9b95-d900a8f1cb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663d4ce1-382e-4a82-b401-30955a4c0a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:16 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Volume volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f (9accc9e5-3eee-4ddd-8e81-488aff3b455f): created successfully Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663d4ce1-382e-4a82-b401-30955a4c0a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Flow 'volume_create_manager' (a3512810-4626-4e62-b8a5-7b08b2155035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:38:16 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-2f0ff712-488d-4505-b087-4cb51e6ee500 tempest-ProjectReaderTests-201529024 None] Created volume successfully. Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Acquiring lock "cinder-9accc9e5-3eee-4ddd-8e81-488aff3b455f-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Lock "cinder-9accc9e5-3eee-4ddd-8e81-488aff3b455f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Acquiring lock "cinder-quobyte-9accc9e5-3eee-4ddd-8e81-488aff3b455f" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Lock "cinder-quobyte-9accc9e5-3eee-4ddd-8e81-488aff3b455f" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9b4098-bac0-45d5-8afa-4ff283ef822c]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:16 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f Sep 17 07:38:16 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:16 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f" returned: 0 in 0.351s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:16 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:16 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f Sep 17 07:38:16 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:17 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-9accc9e5-3eee-4ddd-8e81-488aff3b455f" returned: 0 in 0.237s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Lock "cinder-quobyte-9accc9e5-3eee-4ddd-8e81-488aff3b455f" released by "delete_volume" :: held 0.629s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:17 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Created reservations ['bee5d029-754a-4f14-b5b3-defd54adc0a2', '6d3e91d4-a98a-4877-b0a3-32c1a614c862', '1d5a3cf3-17ee-4c80-8b02-a72e04b93f4b', 'e431a447-2545-4505-80be-574d08154993'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:38:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:38:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:38:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:38:17 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:38:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:38:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:17 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:38:17 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:17 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:17 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.238s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:17 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:38:17 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Deleted volume successfully. Sep 17 07:38:17 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-3f78326a-d850-45a5-8bb2-37c28d50f428 tempest-ProjectReaderTests-201529024 None] Lock "cinder-9accc9e5-3eee-4ddd-8e81-488aff3b455f-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.flows.manager.create_volume [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86029) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Flow 'volume_create_manager' (568b0d11-5f72-4b4b-87c5-337767ec1a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e41ca5-826d-49f3-88ab-1252c8c2a8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e41ca5-826d-49f3-88ab-1252c8c2a8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1249537102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e32dac2b-9910-4f70-b091-602cc725ba91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2543a3eeda4ae28632361eea2bfd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:38:18Z,use_quota=True,user_id='dae4c69a4fd54d5d91d3f14fc874a80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fea6dae-ee53-4dc0-98e7-18c7d4b01bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fea6dae-ee53-4dc0-98e7-18c7d4b01bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd33ece-ff7b-4b11-8b23-3af2269d74b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd33ece-ff7b-4b11-8b23-3af2269d74b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e32dac2b-9910-4f70-b091-602cc725ba91', 'volume_name': 'volume-e32dac2b-9910-4f70-b091-602cc725ba91', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b712ab-180b-4e2b-89c2-da002202d67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b712ab-180b-4e2b-89c2-da002202d67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3adf3898-214c-454c-a520-6113b764dae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:18 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Volume e32dac2b-9910-4f70-b091-602cc725ba91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e32dac2b-9910-4f70-b091-602cc725ba91', 'volume_size': 1} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T05:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1249537102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e32dac2b-9910-4f70-b091-602cc725ba91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2543a3eeda4ae28632361eea2bfd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T05:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T05:38:18Z,use_quota=True,user_id='dae4c69a4fd54d5d91d3f14fc874a80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462ef13a-ec3d-4fa2-8f3e-3995974283eb),volume_type_id=462ef13a-ec3d-4fa2-8f3e-3995974283eb)}" {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.remotefs [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Creating volume e32dac2b-9910-4f70-b091-602cc725ba91 {{(pid=86029) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Selected osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 as target Quobyte volume. {{(pid=86029) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 07:38:18 devstack cinder-volume[86029]: INFO cinder.volume.drivers.remotefs [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] casted to osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57 Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e32dac2b-9910-4f70-b091-602cc725ba91 1073741824 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:18 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e32dac2b-9910-4f70-b091-602cc725ba91 1073741824 Sep 17 07:38:18 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:18 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e32dac2b-9910-4f70-b091-602cc725ba91 1073741824" returned: 0 in 0.408s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e32dac2b-9910-4f70-b091-602cc725ba91 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:18 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e32dac2b-9910-4f70-b091-602cc725ba91 Sep 17 07:38:18 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:18 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e32dac2b-9910-4f70-b091-602cc725ba91" returned: 0 in 0.243s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'} {{(pid=86029) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3adf3898-214c-454c-a520-6113b764dae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e32dac2b-9910-4f70-b091-602cc725ba91', 'volume_size': 1}' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338d8e78-30bb-4e8f-b0fd-5f5eba083f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 07:38:18 devstack cinder-volume[86029]: INFO cinder.volume.flows.manager.create_volume [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Volume volume-e32dac2b-9910-4f70-b091-602cc725ba91 (e32dac2b-9910-4f70-b091-602cc725ba91): created successfully Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338d8e78-30bb-4e8f-b0fd-5f5eba083f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86029) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 07:38:18 devstack cinder-volume[86029]: DEBUG cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Flow 'volume_create_manager' (568b0d11-5f72-4b4b-87c5-337767ec1a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86029) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 07:38:18 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-433997e6-ad8a-46bf-bc84-6fe8a373bb66 tempest-ProjectReaderTests-201529024 None] Created volume successfully. Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Acquiring lock "cinder-e32dac2b-9910-4f70-b091-602cc725ba91-delete_volume" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Lock "cinder-e32dac2b-9910-4f70-b091-602cc725ba91-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Acquiring lock "cinder-quobyte-e32dac2b-9910-4f70-b091-602cc725ba91" by "delete_volume" {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Lock "cinder-quobyte-e32dac2b-9910-4f70-b091-602cc725ba91" acquired by "delete_volume" :: waited 0.016s {{(pid=86029) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d3a8e5-350a-46d6-a05e-d673311e98f2]: (4, 'qcow2') {{(pid=87223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e32dac2b-9910-4f70-b091-602cc725ba91 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:19 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e32dac2b-9910-4f70-b091-602cc725ba91 Sep 17 07:38:19 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:19 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e32dac2b-9910-4f70-b091-602cc725ba91" returned: 0 in 0.355s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e32dac2b-9910-4f70-b091-602cc725ba91 {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:19 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e32dac2b-9910-4f70-b091-602cc725ba91 Sep 17 07:38:19 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:19 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb/volume-e32dac2b-9910-4f70-b091-602cc725ba91" returned: 0 in 0.242s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Lock "cinder-quobyte-e32dac2b-9910-4f70-b091-602cc725ba91" released by "delete_volume" :: held 0.637s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG cinder.quota [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Created reservations ['e6bfb506-446d-4e73-a439-a5efdca42731', '17042aa2-aeb1-4302-a069-5387e1bae52c', 'b133487b-ee26-45f5-a1e6-683c40d4ab2e', '585833a3-769f-44aa-99a6-66a153f0c4c6'] {{(pid=86029) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57': None} {{(pid=86029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG cinder.volume.drivers.quobyte [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-672e4b87-ade6-428b-b110-6b8f29665d57'] {{(pid=86029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.lockutils [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 07:38:19 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 07:38:19 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb Sep 17 07:38:19 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:38:20 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 17 07:38:20 devstack cinder-volume[86029]: DEBUG oslo_concurrency.processutils [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/662c56c4f23a4a8da23353214c1e59fb" returned: 0 in 0.237s {{(pid=86029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 07:38:20 devstack cinder-volume[86029]: DEBUG cinder.manager [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Notifying Schedulers of capabilities ... {{(pid=86029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 07:38:20 devstack cinder-volume[86029]: INFO cinder.volume.manager [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Deleted volume successfully. Sep 17 07:38:20 devstack cinder-volume[86029]: DEBUG cinder.coordination [None req-26915080-cbed-466d-b064-68af2129bc0f tempest-ProjectReaderTests-201529024 None] Lock "cinder-e32dac2b-9910-4f70-b091-602cc725ba91-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=86029) __release /opt/stack/cinder/cinder/coordination.py:152}}